Log in List your tool
Scale AI logo Scale AI Data Labeling View tool profile

Scale AI updates

The full release history for Scale AI — every new feature, pricing change and integration, sourced from their official changelog and social media, then verified by our editors.

RSS feed
59Updates tracked
3Avg. updates / month
May 2024Added On
May 26Last updated
Sourced from Scale AI's official changelog and social media, verified by our editors.

Showing 6 of 59 updates

Earlier

What's New

Scale AI Highlights Growth Beyond Autonomous Vehicles

Scale AI is reflecting on its evolution from supporting self-driving cars to building infrastructure used across AI labs, enterprises, governments, and mission-critical systems. The company positions its platform as foundational technology for large-scale AI deployment and operational workflows. The update offers useful industry insights for organizations comparing premium subscription AI services and best rates for enterprise infrastructure. Learn more about Scale AI’s broader role in the AI ecosystem today.

via Source
AI Safety and Security

WebGuard Enhances AI Safety for Web Agents

WebGuard, developed by Scale AI with UC Berkeley and Ohio State University, is a pioneering dataset designed to assess and improve the safety of AI web agents. It features 4,939 human-annotated actions from 193 websites, categorized by risk levels to guide safe decision-making. Fine-tuning with WebGuard significantly boosts model accuracy, with smaller models like Qwen2.5-VL-7B achieving up to 80% accuracy in identifying high-risk actions. Researchers invite the community to use the public dataset to advance AI safety.

via Source
Podcast

Scale AI Team Tackles Controversial AI Statements

In Episode 9 of Scale AI’s Human in the Loop podcast, the Enterprise team debates bold AI claims, like whether coding agents will replace engineers or if fine-tuning is obsolete due to large context windows. They explore barriers to enterprise AI adoption, emphasizing human challenges over technical ones, and discuss the reliability of single versus multi-agent systems. The team’s insights, drawn from working with top enterprises, highlight practical strategies for building effective AI systems. Listen to the episode or read the transcript at scale.com to gain industry insights.

via Source
Awards & Honours

Scale AI Recognized for AI Data Innovation

Scale AI, a leader in data annotation, earned a spot on TIME’s 2025 list of the 100 Most Influential Companies for its critical role in advancing AI through high-quality data labeling. With over 240,000 gig workers, Scale supports major AI firms, though its recent $14.3 billion Meta deal may shift ties with rivals like OpenAI. Its new division, backed by a U.S. Department of Defense contract, rapidly grows by tailoring AI models for large organizations. Learn more at scale.com.

via Source
AI Safety and Security

Scale AI’s FORTRESS Enhances AI Safety Evaluation

Scale AI introduces FORTRESS, a benchmark designed to evaluate large language models (LLMs) for national security and public safety risks. Featuring over 1,010 expert-crafted adversarial prompts, FORTRESS assesses model safeguards across domains like Chemical, Biological, Radiological, Nuclear and Explosive (CBRNE) activities, ensuring robust protection against misuse while minimizing over-refusals of benign requests. It provides a balanced, scalable framework with instance-specific rubrics for precise evaluation. Visit scale.com to explore the FORTRESS leaderboard and methodology.

via Source
AI Tool Benchmarking

Gemini-2.5 Pro Leads SEAL Leaderboards in Reasoning

Google’s Gemini-2.5 Pro preview model has secured the top spot on Scale AI’s SEAL Leaderboards, excelling in expert reasoning and visual understanding benchmarks. Evaluated by domain experts using private datasets, it outperformed competitors in tasks like Humanity’s Last Exam and VISTA, showcasing its strength in complex problem-solving. The leaderboards provide industry insights into AI model capabilities, ensuring trustworthy rankings. Visit scale.com/leaderboard to explore the full rankings.

via Source
🔍

No updates match your filters

Try a different keyword or clear a filter to see more.

Disclaimer

The content on this website is written and reviewed by experts in the fields of Artificial Intelligence and Software. Additionally, we may incorporate public opinions sourced from various social media platforms to ensure a comprehensive perspective. Please note that the screenshots and images featured on this website are sourced from Scale AI' website. We extend our gratitude and give full credit to Scale AI for their valuable contributions. This page may include external affiliate links, which could earn us a commission if you decide to make a purchase through those links. However, the opinions expressed on this page are our own, and we do not accept payment for favorable reviews.