Effect of Time Varying LCSS  Matching Envelope - 1

 

The following example shows the effect of a time varying LCSS matching envelope size on the match results. We vary both the temporal and spatial thresholds by linearly increasing or decreasing either one, or both, over time.

We vary both the temporal and spatial thresholds by linearly increasing or decreasing either one, or both, over time.

 

The query is a short walking motion 70 keyframes long (or 2.9 seconds).

Matching parameters: LCSS, rotational parameterization, full-body area, no global position, no global rotation.

 

LCSS Example 1

 

Video Description

(in order of appearance)


Full-size video

  1. The query
  2. Long pause
  3. δ=1 and ε=1:0.1  The  best 5-matches, from best to worst.
  4. Long pause
  5. δ=20:2 and ε=1:0.1  The  best 5-matches, from best to worst.
  6. Long pause
  7. δ=2:20 and ε=0.1:1  The  best 5-matches, from best to worst.
  8. Long pause
  9. δ=20:2 and ε=0.1:1  The  best 5-matches, from best to worst.
  10. Long pause
  11. δ=2:20 and ε=1:0.1 The  best 5-matches, from best to worst.

Note: ε=1:0.1 means ε varies from 1 to 0.1 where ε=1 at the start of query, and ε=0.1 at the end of the query.

 

 

Effect of LCSS Matching Envelope on Body Areas - 2

 

With a similar effect as weights for the Euclidean and DTW matching, we vary the spatial threshold for different body areas. For example, we can give more importance to the upper-body joints and less to the lower-body joints. This is done by giving the upper-body joints smaller spatial thresholds, and lower-body joints larger spatial thresholds.

In this examples, we vary the upper-body versus the lower-body joint spatial thresholds to see the impact on the search results. We keep the temporal threshold δ=5 fixed for all examples.

 

The query is a short walking motion 70 keyframes long (or 2.9 seconds).

Matching parameters: LCSS, rotational parameterization, full-body area, no global position, no global rotation.

 

LCSS Example 2

 

Video Description

(in order of appearance)


Full-size video

  1. The query
  2. Long pause
  3. εupper=0.8 and εlower=0.2. The  best 5-matches, from best to worst.
  4. Long pause
  5. εupper=0.2 and εlower=0.8 The  best 5-matches, from best to worst.
  6. Long pause
  7. εupper=0.1 and εlower=0.5. The  best 5-matches, from best to worst.
  8. Long pause
  9. εupper=0.5 and εlower=0.1 The  best 5-matches, from best to worst.

Note: εupper=0.8 means that the upper body degrees of freedom are given a spatial threshold of 0.3. These include the head, back, shoulders and arms. εlower   refers to all remaining joints.