AI/ML News & Innovations Hub

AI/ML news, top picks, and generated innovation digests.

★ Visit ai-karthik.com
422Sources
26009News Items
8Top Picks
157Blogs
runningLast Run

Latest AI/ML News

26009 matching items

Cross Validated 2026-05-04 20:56 UTC Score 17.0 AI-113-20260504-social-media-46a07d17

Transforming skewed data to identify outliers

I have a number of right-skewed (sometimes highly skewed) datasets. It represents count data, where each point represents a single business with a single count for an activity. There is only one data point with one variable per business. For the purposes of fraud detection I am trying to identify which points are outliers. The purpose is to use the outliers as jumping-off points for investigation--i.e. if a count associated with a business is an outlier, we would like to investigate the activities of that business further. I am not interested in removing these outliers from the dataset. Currently I am using an adjusted boxplot ( Hubert & Vandervieran) with outliers outside [Q 1 - he -4(medcouple) IQR; Q 3 +he 3(medcouple) IQR], where h = 1.5 . However, I have thousands, sometimes hundreds of thousands, of points, and the above method takes a lot of memory and generates hundreds of outliers (i.e. hundreds of businesses to potentially investigate). Would it be statistically valid to instead perform some monotonic transformation on the skewed data (removing no points beforehand), and then use p-value to identify the outlying points? I do not know the underlying distribution of the dataset, so I would be trying different transformations until some test for normality turned up positive. EDIT: This question is different from the last one because the last one was closed for being too broad. I tried to focus this one more narrowly. I also attempted to clarify this post in order to a…

Instacart Tech Blog 2026-05-04 19:11 UTC Score 26.0 USR-0056-20260504-ai-specialis-1f53d374 Full article

Empowering Carrot Ads with Domain Adaptive Learning

Authors: Trey Zhong, Xiyu Wang Contributors: Joseph Haraldson, Sharad Gupta, Sarah Lamacchia Introduction Carrot Ads is Instacart’s omnichannel retail media solution that allows retailer partners to build and scale their own advertising businesses on either their owned-and-operated (O&O) websites and apps or their whitelabel Storefront hosted by Instacart. Carrot Ads empowers retailers and CPG brands to accelerate revenue, while improving the customer experience, engagement and Ads return on investment. It features enterprise-grade infrastructure, AI-powered optimization, years of proprietary first-party data and flexibility to choose from retailer-sourced Ads demand, Instacart-sourced demand from 7,500+ CPG brands, or both. However, onboarding a new partner onto Carrot Ads introduces a key challenge: the ‘cold start’ problem, where limited historical interactions make it difficult to predict user behavior accurately. To serve performant ads, our systems rely on predicting a user’s Click-Through Rate (CTR) to generate a ranking score. On the Instacart Marketplace, we have billions of historical signals to train a model to do so. But when a partner launches a new ads experience on their O&O e-commerce site, there is often little to no interaction history for that property, so training an accurate model becomes challenging. User behavior can vary dramatically between websites — for example, browsing patterns on a grocery site differ from those on a pet supply or electronics si…

Kubernetes Documentation 2026-05-04 18:35 UTC Score 22.0 AI-200-20260504-developer-an-230d007e Full article

Kubernetes v1.36: Admission Policies That Can't Be Deleted

If you've ever tried to enforce a security policy across a fleet of Kubernetes clusters, you've probably run into a frustrating chicken-and-egg problem. Your admission policies are API objects, which means they don't exist until someone creates them, and they can be deleted by anyone with the right permissions. There's always a window during cluster bootstrap where your policies aren't active yet, and there's no way to prevent a privileged user from removing them. Kubernetes v1.36 introduces an alpha feature that addresses this: manifest-based admission control . It lets you define admission webhooks and CEL -based policies as files on disk, loaded by the API server at startup, before it serves any requests. The gap we're closing Most Kubernetes policy enforcement today works through the API. You create a ValidatingAdmissionPolicy or a webhook configuration as an API object, and the admission controller picks it up. This works well in steady state, but it has some fundamental limitations. During cluster bootstrap, there's a gap between when the API server starts serving requests and when your policies are created and active. If you're restoring from a backup or recovering from an etcd failure, that gap can be significant. There's also a self-protection problem. Admission webhooks and policies can't intercept operations on their own configuration resources. Kubernetes skips invoking webhooks on types like ValidatingWebhookConfiguration to avoid circular dependencies. That mea…

Meet the Finalists: JetBrains x Codex Hackathon
JetBrains AI Blog 2026-05-04 16:12 UTC Score 38.0 USR-0065-20260504-ai-specialis-68919e42 Full article

Meet the Finalists: JetBrains x Codex Hackathon

Put a capable coding model inside a developer’s primary workspace, and the IDE stops being a place where you write code. It becomes a place where you direct an agent, watch how it reasons, manage what it pays attention to, and decide when its output is worth shipping. That was the defining theme of the […]

Interconnects 2026-05-04 15:56 UTC Score 20.0 USR-0104-20260504-ai-specialis-2de76fa2 Full article

The distillation panic

‘Distillation attacks’ is a horrible term for what is happening right now.

The AI Progress Chart Everyone Is Misreading — Beth Barnes & David Rein
Machine Learning Street Talk 2026-05-04 11:37 UTC Score 66.0 AI-141-20260504-podcasts-and-09bc7d97 Full article

The AI Progress Chart Everyone Is Misreading — Beth Barnes & David Rein

Beth Barnes and David Rein on the one graph that ate the AI timelines discourse, and why the two people who built it are the most careful about how you read it. **SPONSOR** Prolific - Quality data. From real people. For faster breakthroughs. https://www.prolific.com/?utm_source=mlst Interview: https://youtu.be/cnxZZTl1tkk --- Beth Barnes and David Rein from METR on the one graph that ate the AI timelines discourse, and why the people who built it are the most careful about how it gets read. Beth founded METR after leaving OpenAI alignment. David is first author on GPQA and co-author on HCAST and the METR Time Horizons paper. Together they built the measurement Daniel Kokotajlo called the single most important piece of evidence on AI timelines: the log-linear line of "how long a task a frontier model can complete at 50% reliability" vs release date. The conversation opens on reward hacking. Current models can articulate in chat why a behaviour is undesired and then execute it anyway as agents. From there: construct validity, Melanie Mitchell's four-problem taxonomy, and the ARC-AGI 1-to-2 collapse as a worked example of adversarially-selected benchmarks regressing once labs target them. Beth's counter: METR deliberately does not adversarially select. David's: models do not have to do the right thing for the right reasons. Methodology, then specification — David's compiler analogy, Beth on four-month tasks as expensive to evaluate rather than unspecifiable. Then the SWE-bench…

Research ICT Africa AI 2026-05-04 09:46 UTC Score 32.0 USR-0187-20260504-regional-new-3fc12a4e Full article

How do we move the CRASA Summit’s commitment to collaborative regulation from intent to evidence-led action?

The G5 Regulatory Collaboration Summit 2026, hosted by the Communications Regulators’ Association of Southern Africa (CRASA) and the Malawi Communications Regulatory Authority (MACRA) at the Bingu International Convention Center in […] The post How do we move the CRASA Summit’s commitment to collaborative regulation from intent to evidence-led action? appeared first on Research ICT Africa .

Pinecone Blog 2026-05-04 08:01 UTC Score 42.0 USR-0072-20260504-ai-specialis-ac662cc4

Better Models Won’t Save Your Agent

Most agent failures are data failures, not model failures. Pinecone Nexus is a Knowledge Engine that compiles enterprise data into structured artifacts agents can query in one step.

Pinecone Blog 2026-05-04 07:01 UTC Score 41.0 USR-0072-20260504-ai-specialis-a63b1231 Full article

Pinecone Nexus: The Knowledge Engine for Agents

Pinecone Nexus is a knowledge engine for the agentic AI era, moving reasoning from retrieval to compilation — with KnowQL as the standard query language for agents.

Eugene Yan Blog 2026-05-03 00:00 UTC Score 25.0 USR-0114-20260503-ai-specialis-ad4ece22 Full article

How to Work and Compound with AI

Context as infra, taste as config, verification for autonomy, scale via delegation, closing the loop.

CSET AI 2026-05-01 21:00 UTC Score 30.0 USR-0136-20260501-research-aca-442b00ab Full article

US military reaches deals with 7 tech companies to use their AI on classified systems

CSET’s Helen Toner shared her expert insight in an article published by the Associated Press. The article examines the Pentagon’s agreements with seven major tech companies to integrate artificial intelligence (AI) into classified military systems, expanding AI use in decision-making, logistics, and battlefield operations. The post US military reaches deals with 7 tech companies to use their AI on classified systems appeared first on Center for Security and Emerging Technology .

CSET AI 2026-05-01 21:00 UTC Score 33.0 USR-0136-20260501-research-aca-882596f3 Full article

DOD expands its classified AI work with 8 companies — excluding Anthropic — amid ongoing dispute

CSET’s Lauren Kahn shared her expert insight in an article published by DefenseScoop. The article explores the Pentagon’s growing efforts to integrate advanced artificial intelligence (AI) capabilities into classified military operations and the broader implications of expanding AI adoption across the Department of Defense. The post DOD expands its classified AI work with 8 companies — excluding Anthropic — amid ongoing dispute appeared first on Center for Security and Emerging Technology .

CSET AI 2026-05-01 21:00 UTC Score 27.0 USR-0136-20260501-research-aca-59d91cdf Full article

Space Is Critical Infrastructure—It Needs an Alliance To Guard It

CSET’s Kathleen Curlee and former U.S. Air Force pilot Brian Golden shared their expert analysis in an op-ed published by Newsweek. The article discusses the growing importance of space infrastructure to modern life and argues that increased international coordination is needed to ensure the security and stability of the space domain. The post Space Is Critical Infrastructure—It Needs an Alliance To Guard It appeared first on Center for Security and Emerging Technology .

Kubernetes Documentation 2026-05-01 18:35 UTC Score 29.0 AI-200-20260501-developer-an-488bace3 Full article

Kubernetes v1.36: Pod-Level Resource Managers (Alpha)

Kubernetes v1.36 introduces Pod-Level Resource Managers as an alpha feature, bringing a more flexible and powerful resource management model to performance-sensitive workloads. This enhancement extends the kubelet's Topology, CPU, and Memory Managers to support pod-level resource specifications ( .spec.resources ), evolving them from a strictly per-container allocation model to a pod-centric one. Why do we need pod-level resource managers? When running performance-critical workloads such as machine learning (ML) training, high-frequency trading applications, or low-latency databases, you often need exclusive, NUMA-aligned resources for your primary application containers to ensure predictable performance. However, modern Kubernetes pods rarely consist of just one container. They frequently include sidecar containers for logging, monitoring, service meshes, or data ingestion. Before this feature, this created a trade-off, to get NUMA-aligned, exclusive resources for your main application, you had to allocate exclusive, integer-based CPU resources to every container in the pod. This might be wasteful for lightweight sidecars. If you didn't do this, you forfeited the pod's Guaranteed Quality of Service (QoS) class entirely, losing the performance benefits. Introducing pod-level resource managers Enabling pod-level resources support for the resource managers (via the PodLevelResourceManagers and PodLevelResources feature gates) allows the kubelet to create hybrid resource alloca…

Carnegie Council AI 2026-05-01 16:00 UTC Score 22.0 USR-0160-20260501-ai-specialis-8597bfd2 Full article

U.S. Power and Principle

James Story, former U.S. ambassador to Venezuela, visits Carnegie Council to discuss the new dynamic between American power and principle.

Access Now AI 2026-05-01 12:01 UTC Score 24.0 USR-0142-20260501-ai-specialis-2cb2191e Full article

Stay informed: Get Access Now updates

Here's where you can subscribe to the Access Now Express newsletter and action alerts. The post Stay informed: Get Access Now updates appeared first on Access Now .

TWIML AI Podcast 2026-04-30 20:21 UTC Score 56.0 AI-148-20260430-podcasts-and-779fdbb8 Full article

How to Engineer AI Inference Systems with Philip Kiely - #766

In this episode, Philip Kiely, head of AI education at Baseten, joins us to unpack the fast-evolving discipline of inference engineering. We explore why inference has become the stickiest and most critical workload in AI, how it blends GPU programming, applied research, and large-scale distributed systems, and where the line sits between inference and model serving. Philip shares how research-to-production can move in hours, not months, and why understanding “the knobs” of inference—batching, quantization, speculation, and KV cache reuse—lets teams design better products and SLAs. We trace the inference maturity journey from closed APIs to dedicated deployments and in-house platforms, discuss GPU lifecycles, and survey today’s runtime landscape, including vLLM, SGLang, and TensorRT LLM. Finally, we look ahead to agents and multimodality, making the case for specialized, workload-specific runtimes when performance and efficiency matter most. The complete show notes for this episode can be found at https://twimlai.com/go/766.

CSET AI 2026-04-30 19:45 UTC Score 24.0 USR-0136-20260430-research-aca-e576a1ae Full article

CSET Senior Fellow Andrew Lohn Testifies Before U.S.-China Economic and Security Review Commission

Washington, D.C. (April 30, 2026) — This morning, Andrew Lohn, Senior Fellow at Georgetown University’s Center for Security and Emerging Technology (CSET), testified before the U.S.-China Economic and Security Review Commission. The post CSET Senior Fellow Andrew Lohn Testifies Before U.S.-China Economic and Security Review Commission appeared first on Center for Security and Emerging Technology .

Ben’s Bites 2026-04-30 13:03 UTC Score 5.0 AI-128-20260430-newsletters-053e21e3 Full article

Building gets easier

My tool stack is changing

Cloudflare AI Blog 2026-04-30 13:00 UTC Score 40.0 USR-0067-20260430-ai-specialis-7be81092 Full article

Agents can now create Cloudflare accounts, buy domains, and deploy

Starting today, agents can now be Cloudflare customers. They can create a Cloudflare account, start a paid subscription, register a domain, and get back an API token to deploy code right away. Humans can be in the loop to grant permission, but there’s no need to go to the dashboard, copy and paste API tokens, or enter credit card details.

AlgorithmWatch 2026-04-30 09:55 UTC Score 35.0 USR-0154-20260430-ai-specialis-0c2e24d6 Full article

How to actually protect against digital sexualized violence

AlgorithmWatch has put forward recommendations on how to implement a ban of deepfakes in the AI Act as part of the AI Omnibus procedure. To effectively protect victims of digital sexualized violence, AI companies, platforms, and perpetrators must consistently be held accountable.

Allen Institute for AI Blog 2026-04-30 08:00 UTC Score 30.0 USR-0021-20260430-research-aca-0d6eecc5 Full article

AstaBench update: New results, plus adoption from industry

AstaBench’s latest update adds new frontier-model results, including GPT-5.5, and highlights growing adoption from groups including the UK AISI, General Reasoning, Elicit, SciSpace, Distyl AI, and EvoScientist.

How LanceDB Accelerates Vector Search at 10 Billion Scale
LanceDB Blog 2026-04-30 00:30 UTC Score 24.0 USR-0078-20260430-ai-specialis-092f1184 Full article

How LanceDB Accelerates Vector Search at 10 Billion Scale

How LanceDB applies distributed indexing, distributed query execution, HNSW centroid routing, and fast RaBitQ rotation to scale search to 10B vectors and beyond.

CSET AI 2026-04-29 21:00 UTC Score 27.0 USR-0136-20260429-research-aca-73923736 Full article

Entry-level jobs calling for AI skills nearly doubled from a year ago, says report

CSET’s Ali Crawford shared her expert insight in an article published by CNBC. The article examines how the 2026 graduating class is entering a tightening job market where AI skills are increasingly in demand across internships and entry-level roles, while education and workforce systems struggle to keep pace with rapidly evolving employer expectations. The post Entry-level jobs calling for AI skills nearly doubled from a year ago, says report appeared first on Center for Security and Emerging Technology .

Allen Institute for AI Blog 2026-04-29 08:00 UTC Score 38.0 USR-0021-20260429-research-aca-d2c9c32c Full article

Molmo learns to point and act

MolmoPoint and MolmoWeb extend the Molmo family from visual understanding to visual action, giving researchers open tools for models that can point, navigate, and interact with the world they see.

Qdrant Blog 2026-04-29 00:00 UTC Score 27.0 USR-0074-20260429-ai-specialis-e38814f0 Full article

Presenting Sentinel - Gen AI Zürich Hackathon Winner

When Ali Aoun Mehdi watched two major global news outlets report opposite facts during the Iran-US conflict, he saw a critical problem: misinformation spreading in real-time. From Islamabad, participating virtually in the Gen AI Zürich Hackathon, he built Sentinel to close this “fact-gap” by detecting contradictions across news sources instantly. Sentinel is an AI-powered early warning system that monitors 20 global news sources every 30 minutes. It identifies factual contradictions in under 30 seconds, providing users with a misinformation risk score and narrative traction assessment.

Access Now AI 2026-04-28 18:31 UTC Score 22.0 USR-0142-20260428-ai-specialis-e835612b Full article

Tell governments: #NoExamShutdown

Each year sees an increase in the number of governments imposing internet shutdowns during national school exams. It's time to take action and demand change! #NoExamShutdown The post Tell governments: #NoExamShutdown appeared first on Access Now .

Cross Validated 2026-04-28 15:14 UTC Score 18.0 AI-113-20260428-social-media-ef6a04c8

cross validation with classical forward selection

I have been reading about feature selection for ML models and I saw an explanation why this model presents some issues. For what I know in forward selection you start with a set of features and then, one by one, we check their statistical significance calculating their p-values. If one feature is more significant the others (regarding their p-value) then I add this feature to a list and I remove it from the list of features to be tested. This process continues until there are no more features to test. So if I have a significance level of 0.05, then I could say that the probability of having a false positive is: $$p(false\ positive)=0.05$$ and the probability of no false positive would be: $$p(no\ false\ positive)=1-0.05=0.95$$ If I assume that these events are independent and if I have ten features I will end up with: $$p(\sim false\ positive)=0.95^{10}$$ so the $$p(at\ least\ one\ false\ positive)=1-0.95^{10}=0.402$$ therefore this result that I will have a 40% chance that one feature would be deemed like relevant, but in reality it is not. The question that I have is how the use of cross validation would help to avoid this issue?

Access Now AI 2026-04-28 14:13 UTC Score 24.0 USR-0142-20260428-ai-specialis-0eef9cc8 Full article

Mi Privacidad es mi Voto: Fortaleciendo la integridad informativa en América Latina

El vínculo entre la desinformación y la privacidad La desinformación impulsada por internet y el uso de las redes sociales supone un desafío que muchos hacedores de políticas están abordando The post Mi Privacidad es mi Voto: Fortaleciendo la integridad informativa en América Latina appeared first on Access Now .

Ben’s Bites 2026-04-28 13:54 UTC Score 3.0 AI-128-20260428-newsletters-4d208c3c Full article

Builders

GPT-5.5 is a good model

Vector Institute News 2026-04-28 13:05 UTC Score 35.0 USR-0017-20260428-research-aca-c50ad335 Full article

Hassan Ashtiani: Building trustworthy AI through mathematical foundations

Hassan Ashtiani, Professor, McMaster University | Vector Institute Faculty Member You want to share your medical data to help advance research, but you don’t want others to access your private […] The post Hassan Ashtiani: Building trustworthy AI through mathematical foundations appeared first on Vector Institute for Artificial Intelligence .