Cron / schedule errors

Missed jobs · flock gaps · morning list failures — newest first

All Open only Source: schedule_miss_events · auditor trading:audit-schedule-misses Dashboard
When (UTC) Day Severity Job Code Error Status
2026-07-26 10:33:02 2026-07-26 CRITICAL schedule:run LOCK_HOLDER_CLEARED
Stale schedule lock holders killed
Watchdog cleared 1 PID(s) holding /tmp/laravel-schedule.lock so schedule:run can run again.
context
{
    "killed": [
        3190923
    ],
    "holders": [
        {
            "pid": 3190923,
            "etime_seconds": 1,
            "cmd": "flock -n -o /tmp/laravel-schedule.lock -c cd /var/www/html/tradding_app && /usr/bin/php artisan schedule:run >> /var/www/html/tradding_app/storage/logs/scheduler.log 2>&1 ",
            "kill_reason": "pulse_stale_null"
        }
    ],
    "pulse_age": null,
    "max_age": 120
}
open
2026-07-24 22:15:02 2026-07-24 WARNING learning:nightly-agent MISSED_SLOT
Nightly learning agent missed
Job learning:nightly-agent has no heartbeat after expected slot 17:45 ET.
context
{
    "slot_et": "2026-07-24T17:45:00-04:00",
    "deadline_et": "2026-07-24T18:15:00-04:00",
    "last_run_unix": null,
    "age_seconds": null
}
open
2026-07-24 17:47:03 2026-07-24 WARNING premarket:start-day MISSED_SLOT
Morning start-day missed
Job premarket:start-day has no heartbeat after expected slot 07:20 ET.
context
{
    "slot_et": "2026-07-24T07:20:00-04:00",
    "deadline_et": "2026-07-24T07:35:00-04:00",
    "last_run_unix": null,
    "age_seconds": null
}
open
2026-07-24 14:20:03 2026-07-24 WARNING premarket:freeze-official-watchlist MISSED_SLOT
Watchlist freeze missed
Job premarket:freeze-official-watchlist has no heartbeat after expected slot 10:05 ET.
context
{
    "slot_et": "2026-07-24T10:05:00-04:00",
    "deadline_et": "2026-07-24T10:20:00-04:00",
    "last_run_unix": null,
    "age_seconds": null
}
open
2026-07-24 04:00:02 2026-07-24 CRITICAL schedule:run LOCK_HOLDER_CLEARED
Stale schedule lock holders killed
Watchdog cleared 1 PID(s) holding /tmp/laravel-schedule.lock so schedule:run can run again.
context
{
    "killed": [
        3017867
    ],
    "holders": [
        {
            "pid": 3017867,
            "etime_seconds": 1,
            "cmd": "flock -n -o /tmp/laravel-schedule.lock -c cd /var/www/html/tradding_app && /usr/bin/php artisan schedule:run >> /var/www/html/tradding_app/storage/logs/scheduler.log 2>&1 ",
            "kill_reason": "pulse_stale_14399s"
        }
    ],
    "pulse_age": 14399,
    "max_age": 120
}
open
2026-07-23 22:15:02 2026-07-23 WARNING learning:nightly-agent MISSED_SLOT
Nightly learning agent missed
Job learning:nightly-agent last ran 8640s ago — before today's 17:45 ET slot.
context
{
    "slot_et": "2026-07-23T17:45:00-04:00",
    "deadline_et": "2026-07-23T18:15:00-04:00",
    "last_run_unix": 1784842502,
    "age_seconds": 8640
}
open
2026-07-23 19:32:13 2026-07-23 WARNING premarket:start-day MISSED_SLOT
Morning start-day missed
Job premarket:start-day has no heartbeat after expected slot 07:20 ET.
context
{
    "slot_et": "2026-07-23T07:20:00-04:00",
    "deadline_et": "2026-07-23T07:35:00-04:00",
    "last_run_unix": null,
    "age_seconds": null
}
open
2026-07-23 14:20:03 2026-07-23 WARNING premarket:freeze-official-watchlist MISSED_SLOT
Watchlist freeze missed
Job premarket:freeze-official-watchlist has no heartbeat after expected slot 10:05 ET.
context
{
    "slot_et": "2026-07-23T10:05:00-04:00",
    "deadline_et": "2026-07-23T10:20:00-04:00",
    "last_run_unix": null,
    "age_seconds": null
}
open
2026-07-23 13:27:02 2026-07-23 CRITICAL premarket:ensure-morning-paste MORNING_LIST_MISSING
Morning A+ list missing
No premarket review list for today after 07:10 ET. Cron ensure/generate likely missed (flock skip or job failure).
context
{
    "deadline_et": "2026-07-23T07:10:00-04:00",
    "ensure_age": null,
    "generate_age": 29,
    "start_day_age": 28
}
resolved
2026-07-23 13:32
2026-07-23 13:27:02 2026-07-23 CRITICAL schedule:run SCHEDULE_GAP
Laravel schedule:run gap
No schedule pulse for 300s. Likely flock skip or stuck lock (schedule:run did not run).
context
{
    "pulse_age_seconds": 300,
    "detected_et": "2026-07-23T09:27:02-04:00"
}
open
2026-07-23 13:27:02 2026-07-23 CRITICAL schedule:run LOCK_HOLDER_CLEARED
Stale schedule lock holders killed
Watchdog cleared 1 PID(s) holding /tmp/laravel-schedule.lock so schedule:run can run again.
context
{
    "killed": [
        2480669
    ],
    "holders": [
        {
            "pid": 2480669,
            "etime_seconds": 1,
            "cmd": "flock -n -o /tmp/laravel-schedule.lock -c cd /var/www/html/tradding_app && /usr/bin/php artisan schedule:run >> /var/www/html/tradding_app/storage/logs/scheduler.log 2>&1 ",
            "kill_reason": "pulse_stale_14399s"
        }
    ],
    "pulse_age": 14399,
    "max_age": 120
}
open