The R&D lab that takes your AI from “what if” to clear answers.

We run the experiments, benchmarks, and failure analysis that show which models and methods are worth building on.

Bring us a question, a dataset, or a rough prototype. Most projects go from question to answer in 4 to 12 weeks.

What you get

  • Working models: trained on your data, with the code and pipelines to rerun everything.
  • Experiment results: baselines and head-to-head comparisons you can reproduce end to end.
  • Evaluation reports: benchmark numbers and failure analysis for LLMs, search, ranking, and forecasting.
  • Red-team findings: where the system breaks, how often, and what it takes to fix.
  • A decision memo: what to build and what to skip, plus a walkthrough with your team.

Selected clients and collaborators

What we do

Applied machine learning and AI consulting, built around experiments and independent evaluation.

R&D sprints

Baseline comparisons, prototypes, and hard-nosed feasibility checks. See our work.

LLM evaluation & guardrails

Prompting, rubric design, reliability testing, and failure analysis. Learn about our LLM chatbot work.

Search & ranking research

Offline/online metrics, ranking experiments, and user-impact analysis. Read our search engine case study.

Messy data science

Cleaning messy data and testing hypotheses, including on small datasets. Explore our small-dataset benchmarks.

Forecasting & anomaly detection

Model comparisons and uncertainty quantification.

Technical due diligence

Independent evaluation of models and methods.

How we work

We run 4–12 week research sprints. Each ends with experiment results, benchmarks, and documented methods.

  1. 1–2 weeks

    Discovery & data audit

    We start with the decision you need to make, the data you have, and your constraints.

    • Problem framing & success metrics
    • Data quality review
    • Analysis plan & experiment design
  2. 2–8 weeks

    Experiments & evaluation

    We compare baselines and test approaches head-to-head.

    • Model development & prototyping
    • Evaluation design & benchmarking
    • Failure analysis & safety testing
  3. 1–2 weeks

    Findings & handoff

    We write up the results and recommend next steps.

    • Written findings & recommendations
    • Benchmark results & methods documentation
    • Team walkthrough

The team

Sergey Feldman is a Principal Research Scientist at the Allen Institute for AI (Ai2). Previously, he served as Head of AI at Alongside, a youth well-being platform acquired by TimelyCare in 2026. He has led R&D on retrieval, NLP, and LLM systems, including Semantic Scholar and Asta.

Sergey founded Data Cowboys in 2014. He holds a PhD in machine learning from the University of Washington and has been building AI systems since 2007.

Ilya Barshai is a Principal Data Scientist at McGraw Hill, where he applies AI and machine learning to educational technology.

Ilya joined Data Cowboys in 2016. He has spent more than ten years in applied data science, after eight years in risk and failure analysis of electromechanical product designs.

What clients say

Sergey and Ilya grasped what we do the fastest of anyone I’ve explained our startup to. They are professional, timely, and so fast with their thinking and output.

— Jay Goyal, Co-Founder, Actively Learn & Alongside

Sergey has a wonderful knack for quickly scoping a problem, making efficient decisions on model choice and parameters, and clearly communicating throughout the process.

— Apu Mishra, Lead Data Scientist, RichRelevance

Sergey Feldman is brilliant, collaborative, candid, and lightning-fast. He has a special gift for explaining complex analytical concepts in terms anyone can understand.

— Deb Arnold, Principal, Deb Arnold, Inc.

Sergey provides well-considered results quickly with in-depth knowledge communicated clearly to readers at every level.

— Jenny Dearborn, author of Data Driven

Data Cowboys’ work has been incredible. We understand our data, verify our impact, and keep people safe from exploitation.

— Robert Beiser, Seattle Against Slavery

Got an AI or data question?

Let’s figure out what the evidence says before you commit more time and budget.

Want to email instead? Reach us at ilya@data-cowboys.com.