Example illustrating how object and track queries interact using an attention map processed by Cell-TRACTR across two subsequent frames. The schematic displays the actual output alongside the output the from top matching object queries. Extracted from the self-attention mechanism in the decoder, the attention map highlights the strength of interactions among the queries. Lighter colors indicate stronger interactions. The track queries tend to focus on themselves, while the object queries attend to the track query that corresponds most closely in location.

<p>Example illustrating how object and track queries interact using an attention map processed by Cell-TRACTR across two subsequent frames. The schematic displays the actual output alongside the output the from top matching object queries. Extracted from the self-attention mechanism in the dec...

Full description