Back to Blog
EnglishComparison

Haiku 5.5 vs DeepSeek V4.1 Flash: Test Scheduling Gaps and No-Slot Cases

Two models solve the same available-slot and impossible-slot fixtures using integer minutes and half-open intervals. All four strict JSON checks pass; this is not a general scheduling benchmark.

B
Brian J
October 9, 2026 / 369 views
Share:
Haiku 5.5 vs DeepSeek V4.1 Flash: Test Scheduling Gaps and No-Slot Cases

A scheduling answer must fit the requested duration and avoid every blocked interval. This two-model probe includes both an available gap and a case where no valid slot exists, so guessing a plausible time cannot satisfy both.

Crazyrouter was the gateway for this 4-case experiment: 4 cases met the declared complete-output criterion; the results below retain the failures and their limits.

By Brian J · Tested November 3, 2026

Can Haiku 5.5 and DeepSeek V4.1 Flash find a valid scheduling gap?#

Intervals use integer minutes and half-open bounds. In the first case, the search window is [540,660), with [540,570) and [600,630) blocked. The earliest thirty-minute opening is [570,600). In the second case, only twenty minutes remain between blocked intervals, so the expected slot is null.

Both models returned the exact expected object for both cases and finished with stop. The use of a no-slot example matters: an assistant that always proposes something can look helpful while violating the actual constraint.

November 3 experiment and observed results#

The scripts ran on Windows with Python 3.10.2 and synthetic inputs. Gateway generation and catalog requests use https://api.crazyrouter.com; paths and complete payloads appear in the code. Each result describes this run only. A test program exiting successfully means its observations were recorded, not that every model response passed.

Requested model IDVisible to this credential
claude-haiku-5-5Yes
deepseek-v4.1-flashYes
Route / caseHTTP or turnsFinish / outcomeAcceptedObserved output or error
claude-haiku-5-5 / gap200stopYes{"start":570,"end":600}
claude-haiku-5-5 / no slot200stopYes{"slot":null}
deepseek-v4.1-flash / gap200stopYes{"start":570,"end":600}
deepseek-v4.1-flash / no slot200stopYes{"slot":null}

Observed successful-envelope response IDs (failed acceptance can still have an ID):

text
msg_011Cgg8Sxr3osft5AMa9Chdq
msg_011Cgg8T6vEDGXL66Pr6ELaj
b2067577-acb3-4ea2-9f19-f124c18bf308
7a8172a5-f5d4-48eb-927c-ce5ec4cbf7e7

Exact output contract: Complete response and declared JSON or marker required

Understand what the test leaves out#

The fixture does not involve a real calendar, daylight-saving changes, time zones, attendees, resource permissions or concurrent bookings. It only tests small interval reasoning and direct JSON consumption through the named gateway routes.

No meeting was created. A production application should independently validate duration and collisions, then recheck availability when committing a reservation. A previously valid model proposal is not authority to overwrite a new booking.

Keep the comparison proportional to the evidence#

Four correct answers cannot establish an overall winner, a stable latency advantage or current cost per booking. The previous article’s broader benchmark numbers are not combined with this new run. Model defaults and gateway routing may also affect responses, and this test does not claim equal internal reasoning budgets.

Expand the fixture set with adjacent boundaries, fully occupied windows, multiple equivalent gaps and invalid inputs. Use application code as the final constraint checker even when the model provides the first proposal.

Reproduce the experiment#

Install requests, set CRAZYROUTER_API_KEY in the process environment, save this complete script and run it with Python 3.10 or later. Requests use your authorized credential and can consume usage. Authorization headers are not printed.

python
import json
import os
import time
import requests

BASE = "https://api.crazyrouter.com/v1"

def catalog(models):
    with requests.Session() as s:
        s.trust_env=False
        r=s.get(BASE+"/models",headers={"Authorization":"Bearer "+os.environ["CRAZYROUTER_API_KEY"]},timeout=(10,40),allow_redirects=False)
        r.raise_for_status();names={x["id"] for x in r.json()["data"]}
    return {m:m in names for m in models}

def chat(model,prompt,**options):
    payload={"model":model,"messages":[{"role":"user","content":prompt}],**options}
    record={"model":model,"request":payload};start=time.perf_counter()
    try:
        with requests.Session() as s:
            s.trust_env=False
            r=s.post(BASE+"/chat/completions",headers={"Authorization":"Bearer "+os.environ["CRAZYROUTER_API_KEY"]},json=payload,timeout=(10,65),allow_redirects=False)
        record["http"]=r.status_code
        if r.status_code==200:
            d=r.json();c=d["choices"][0];record.update(response_id=d.get("id"),output=c["message"].get("content"),finish=c.get("finish_reason"),usage=d.get("usage",{}))
        else:record["error"]="HTTP_"+str(r.status_code)
    except (requests.RequestException,ValueError,KeyError,IndexError) as e:record["error"]=type(e).__name__
    record["seconds"]=round(time.perf_counter()-start,3)
    return record

def parsed(row):
    if row.get("finish")!="stop":return None
    try:return json.loads(row.get("output") or "null")
    except (ValueError,TypeError):return None

def emit(**data):print(json.dumps(data,ensure_ascii=False))

MODELS = ['claude-haiku-5-5', 'deepseek-v4.1-flash']
CASES = [('gap', 'Find the earliest 30-minute gap in [540,660), blocked [540,570) and [600,630). Return only JSON with start,end as integer minutes.', {'start': 570, 'end': 600}), ('no slot', 'Find a 30-minute gap in [540,600), blocked [540,560) and [580,600). Return only JSON {"slot":null} if none fits.', {'slot': None})]
OPTIONS = {'deepseek-v4.1-flash': {'max_tokens': 2048}}
availability=catalog(MODELS);rows=[]
for model in MODELS:
    if not availability[model]:continue
    for name,prompt,expected in CASES:
        r=chat(model,prompt,**OPTIONS.get(model,{"max_tokens":1024}))
        r.update(case=name,expected=expected)
        r["passed"]=parsed(r)==expected
        rows.append(r)
emit(catalog=availability,requests=rows,criterion="Complete stop plus exact parsed JSON; no fence stripping",local_tests=[])

Catalog visibility and attempted cases: Absent IDs were not silently substituted

Sources checked November 3, 2026: Anthropic model overview, DeepSeek model and pricing reference. Official descriptions and gateway observations are separate evidence.

FAQ#

Did all four requests pass?#

Yes, the two fixtures passed on both routes.

Why use half-open intervals?#

They allow an interval to end exactly when the next one starts without an overlap.

Was a calendar modified?#

No. These were synthetic text tasks.

Does this cover time zones?#

No. Integer-minute examples intentionally avoid them.

Which model is better overall?#

This small tied result does not establish a winner.

Should the model’s slot be booked directly?#

A real application should validate and recheck availability before the booking operation.

Last actually tested: November 3, 2026. This API-dependent article is due for review December 3, 2026.

Implementation Guides

Podcast

AI Dev Tools: The Crazyrouter Podcast

Short episodes for developers on AI APIs, gateways, cost control and coding tools.

Latest episodes

  • EP196 · Oct 29, 2026 · 6:53

    AI API Security Posture — Turn Controls Into Continuous Evidence

    A practical guide to AI API security posture: inventory exposure, verify controls continuously, protect keys and data, constrain tools, and turn security assumptions into evidence that operators can act on.

  • EP195 · Oct 28, 2026 · 7:21

    AI API Policy Drift — Detect When Production Rules Stop Matching Intent

    A practical guide to policy drift in AI APIs: version routing and safety rules, detect stale enforcement, compare intended and observed behavior, and restore control before small gaps become incidents.

Episodes with written show notes →

Topics

ComparisonsComparison

Related Articles

Kimi K3.1 Pro vs Kimi K3: What 36 API Requests Tell UsComparison

Kimi K3.1 Pro vs Kimi K3: What 36 API Requests Tell Us

A 36-request comparison of Kimi K3.1 Pro and K3: where Pro finished more tasks, where the models tied, and what the timings, failures and pricing do—and do not—tell us.

Oct 26
OpenRouter vs Crazyrouter: Pricing, Models, and Which API Gateway Fits Developers BetterComparison

OpenRouter vs Crazyrouter: Pricing, Models, and Which API Gateway Fits Developers Better

A practical OpenRouter vs Crazyrouter comparison covering pricing, model access, OpenAI compatibility, coding workflows, routing flexibility, and developer use cases.

Mar 1
Claude vs GPT vs Gemini Stability Comparison in 2026: Which API Is Best for Production?Comparison

Claude vs GPT vs Gemini Stability Comparison in 2026: Which API Is Best for Production?

Compare Claude, GPT, and Gemini on API stability, fallback options, payment friction, and production readiness. Choose the best stack for real deployment.

Apr 16
Self-Hosted Model Readiness: Test an Evidence Gate Before DeploymentComparison

Self-Hosted Model Readiness: Test an Evidence Gate Before Deployment

Six local cases check an explicit readiness record, and a live catalog lookup stays separate from license, artifact, capacity and rollback evidence. No local inference deployment is claimed.

Sep 19
Haiku 5.5 vs Haiku 4.5: Test Strict JSON, False, Zero and NullComparison

Haiku 5.5 vs Haiku 4.5: Test Strict JSON, False, Zero and Null

Two structured text fixtures distinguish exact JSON from fenced objects. Haiku 5.5 passes both; Haiku 4.5 returns matching values inside Markdown fences and fails the raw-JSON contract.

Oct 11
Self-Hosted vs Hosted AI Costs: Test the Break-Even FormulaComparison

Self-Hosted vs Hosted AI Costs: Test the Break-Even Formula

Five Decimal checks explore fixed cost and per-request margins. A live request supplies usage but fails strict JSON parsing, showing why cost per attempt is different from cost per usable output.

Sep 28