Skip to content

fix(label): time lyrics with nixamp.com's ear when ElevenLabs refuses (0.80.6) - #433

Merged
ralyodio merged 1 commit into
mainfrom
fix/lyrics-align-ear-fallback
Nov 14, 2026
Merged

ralyodio merged 1 commit into
mainfrom
fix/lyrics-align-ear-fallback

Conversation

@ralyodio

Copy link
Copy Markdown
Contributor

Lyrics on /music showed as static text: the songs on air had no .lrc. server2's label log shows elevenlabs answered HTTP 401 to the alignment for every song since the key died (all of Þrøngva, Celtic Punk Core and more).

  • src/lyric-align.ts: hears the song through nixamp.com's Whisper ear (/api/v1/speech/transcribe, 60 s windows, phrase timestamps, waits out 429), spreads each phrase's time over its words, lays the known lyric words over the heard ones (LCS with a fuzzy word match), interpolates the unmatched words, and refuses when under 20% matched.
  • aligner(): ElevenLabs first, the ear when ElevenLabs fails; the ear alone without a key.
  • Tried live on Þrøngva "Cut the Clock" from dev2: 105 phrases heard in 80 s, 650 words → 168 timed lines that line up ("They sold the morning by the minute" 45 s, "Every breath became a cost" 52 s).
  • Also fixes the crawl-door test after x402-gateway ^0.18.1: training crawlers pay from the first request #432 (training crawlers pay from the first request), which main fails today.

Tests: new test/lyric-align.test.ts; full suite 1157 pass locally (2 local-only failures that need no session on the box).

🤖 Generated with Claude Code

…, so the karaoke follows again (0.80.6)

The label's ElevenLabs aligner answers 401 on server2, so every song since
(all of Þrøngva, Celtic Punk Core, ...) has no .lrc and /music shows static
words. src/lyric-align.ts hears the song through nixamp.com's Whisper ear a
minute at a time (phrase timestamps), lays the known lyric words over the
heard ones (longest common run, fuzzy match), interpolates the rest, and
refuses a song where under a fifth matched. aligner() tries ElevenLabs first
and falls back to the ear; without a key it uses the ear alone.

Also: the crawl-door test follows x402-gateway 0.18.1 (#432): a training
crawler pays from its first request.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown

ThreatCrush Security Scan

0 finding(s) in the 6 file(s) this pull request changes.

Nothing in the files this pull request changes.

56 pre-existing finding(s) elsewhere in the repository — **HIGH**: 17 | **MEDIUM**: 15 | **LOW**: 24

Not introduced by this pull request.

Severity Rule Location
HIGH secret-database-url .github/workflows/translation.yml:31
HIGH secret-generic-credential src/hls.ts:81
HIGH js-ssrf-outbound-request src/music-hub.ts:304
HIGH js-host-header-trust src/server.ts:3133
HIGH js-host-header-trust src/server.ts:3147
HIGH js-host-header-trust src/server.ts:3164
HIGH js-host-header-trust src/server.ts:3173
HIGH js-host-header-trust src/server.ts:3178
HIGH js-host-header-trust src/server.ts:3281
HIGH js-host-header-trust src/server.ts:3347
HIGH js-host-header-trust src/server.ts:3434
HIGH js-host-header-trust src/server.ts:3462
HIGH js-host-header-trust src/server.ts:3632
HIGH js-host-header-trust src/server.ts:3648
HIGH js-ssrf-outbound-request web/src/app.ts:115
HIGH js-ssrf-outbound-request web/src/app.ts:163
HIGH js-ssrf-outbound-request web/src/app.ts:167
MEDIUM js-unescaped-html-sink backtoschool/src/main.ts:95
MEDIUM js-unescaped-html-sink backtoschool/src/main.ts:241
MEDIUM js-unescaped-html-sink backtoschool/src/main.ts:257

…and 36 more; the full set is in the SARIF artifact.

Snippets are redacted; ThreatCrush never prints matched credential material.

@ralyodio
ralyodio merged commit 8e3c70a into main Nov 14, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant