Grant Gilliam
63cf3026ff
Cross-platform research (Grant) flagged that the colour-border cue differs by app; checking the real brand colours against the detector found a concrete bug: the global 0.5 saturation threshold MISSES Teams' violet ring (#6264A7 ≈ 0.41, light variants ~0.27) entirely and Meet's lighter blue glow (#8ab4f8 ≈ 0.44). Those adapters would have detected nothing. - FrameSampler.saturatedPoints: add a tunable threshold + optional hue-band gate (degrees) so a lowered threshold doesn't pick up warm video. - GridCallAnalyzer.Config: colorSaturation / colorMinBrightness / colorHueRange, plumbed to the colour-border path (defaults preserve prior behaviour). - MeetAdapter sat→0.35 (catch the glow); TeamsAdapter sat→0.22 + hue 215–275° (catch the faint violet, reject other colours); ZoomAdapter sat 0.45 + hue 40–150° (vivid green/yellow). Values are first-pass pending real-fixture calibration; the hue gate is the main calibration lever. Tests: Teams now detects the faint violet ring and rejects a green one; Meet/Zoom vivid cases still pass. 27/27 XCTest.
45 lines
1.8 KiB
Swift
45 lines
1.8 KiB
Swift
import Foundation
|
|
import CoreVideo
|
|
|
|
/// Microsoft Teams adapter (native app: com.microsoft.teams2 / .teams).
|
|
///
|
|
/// Teams' active-speaker cue is a **coloured ring/border** (Teams violet) around
|
|
/// the speaking participant's tile; the **name sits in the tile's bottom-left**.
|
|
/// Not a launch priority — included so the four detected platforms all have a
|
|
/// visual adapter and degrade no worse than colored-border detection.
|
|
///
|
|
/// Detection *logic* is validated on synthetic frames; geometry constants are a
|
|
/// first pass pending real Teams screenshots.
|
|
struct TeamsAdapter: AppAdapter {
|
|
static let bundleIDs = ["com.microsoft.teams2", "com.microsoft.teams"]
|
|
let adapterVersion = "teams-0.1.0"
|
|
let preferredFPS = 3
|
|
|
|
private let analyzer: GridCallAnalyzer
|
|
|
|
init() {
|
|
var config = GridCallAnalyzer.Config()
|
|
config.nameAnchor = .bottomLeft
|
|
config.detectColoredBorder = true // Teams-violet speaking ring (faint)
|
|
config.detectWhiteBorder = false
|
|
// Teams' ring is muted: brand violet #6264A7 ≈ 0.41 sat, light variants
|
|
// ~0.27 — well under the 0.5 default, so the default misses it entirely.
|
|
// Drop the threshold and (since low sat invites warm-video false positives)
|
|
// gate to the violet/indigo hue band. Both pending real-fixture calibration.
|
|
config.colorSaturation = 0.22
|
|
config.colorHueRange = 215...275
|
|
config.tileExpandX = 3.0
|
|
config.tileExpandY = 5.0
|
|
self.analyzer = GridCallAnalyzer(config: config)
|
|
}
|
|
|
|
func analyze(frame: CVPixelBuffer, at t: TimeInterval) -> [SpeakerObservation] {
|
|
analyzer.analyze(pixelBuffer: frame, at: t)
|
|
}
|
|
|
|
// Exposed for fixture/synthetic tests.
|
|
func analyze(cgImage: CGImage, at t: TimeInterval) -> [SpeakerObservation] {
|
|
analyzer.analyze(cgImage: cgImage, at: t)
|
|
}
|
|
}
|