Computes the F-Score of a SDTS prediction.

sdts_score(pred, gtruth, beta = 1)

Arguments

pred

a vector of logical. Predicted annotation from sdts_predict()

gtruth

a vector of logical. Ground truth annotation.

beta

a numeric. See details. (default is 1).

Value

Returns a list with f_score, precision and recall.

Details

beta is used to balance F-score towards recall (>1) or precision (<1).

References

  • Yeh C-CM, Kavantzas N, Keogh E. Matrix profile IV: Using Weakly Labeled Time Series to Predict Outcomes. Proc VLDB Endow. 2017 Aug 1;10(12):1802-12.

Website: https://sites.google.com/view/weaklylabeled

See also

Other Scalable Dictionaries: sdts_predict(), sdts_train()

Examples

# This is a fast toy example and results are useless. For a complete result, run the code inside
#' Not run' section below.
w <- c(110, 220)
subs <- 11000:20000
tr_data <- mp_test_data$train$data[subs]
tr_label <- mp_test_data$train$label[subs]
te_data <- mp_test_data$test$data[subs]
te_label <- mp_test_data$test$label[subs]
model <- sdts_train(tr_data, tr_label, w, verbose = 0)
predict <- sdts_predict(model, te_data, round(mean(w)))
sdts_score(predict, te_label, 1)
# \donttest{
windows <- c(110, 220, 330)
model <- sdts_train(mp_test_data$train$data, mp_test_data$train$label, windows)
#> Stage 1 of 3, compute matrix profile...
#> 
Computing: [====                                    ] 8%  (~12s remaining)       
Computing: [======                                  ] 15%  (~11s remaining)       
Computing: [=========                               ] 22%  (~10s remaining)       
Computing: [============                            ] 29%  (~10s remaining)       
Computing: [===============                         ] 36%  (~9s remaining)       
Computing: [==================                      ] 43%  (~8s remaining)       
Computing: [====================                    ] 50%  (~7s remaining)       
Computing: [=======================                 ] 57%  (~6s remaining)       
Computing: [==========================              ] 64%  (~5s remaining)       
Computing: [=============================           ] 71%  (~4s remaining)       
Computing: [===============================         ] 77%  (~3s remaining)       
Computing: [==================================      ] 84%  (~2s remaining)       
Computing: [=====================================   ] 91%  (~1s remaining)       
Computing: [========================================] 99%  (~0s remaining)       
Computing: [========================================] 100% (done)                         
#> 
Computing: [====                                    ] 9%  (~11s remaining)       
Computing: [=======                                 ] 16%  (~11s remaining)       
Computing: [==========                              ] 23%  (~10s remaining)       
Computing: [============                            ] 30%  (~9s remaining)       
Computing: [===============                         ] 37%  (~8s remaining)       
Computing: [==================                      ] 44%  (~7s remaining)       
Computing: [=====================                   ] 52%  (~6s remaining)       
Computing: [========================                ] 59%  (~5s remaining)       
Computing: [===========================             ] 66%  (~4s remaining)       
Computing: [==============================          ] 73%  (~3s remaining)       
Computing: [================================        ] 80%  (~2s remaining)       
Computing: [====================================    ] 88%  (~1s remaining)       
Computing: [======================================  ] 95%  (~0s remaining)       
Computing: [========================================] 100% (done)                         
#> 
Computing: [====                                    ] 9%  (~11s remaining)       
Computing: [=======                                 ] 16%  (~10s remaining)       
Computing: [==========                              ] 23%  (~10s remaining)       
Computing: [=============                           ] 31%  (~9s remaining)       
Computing: [================                        ] 38%  (~8s remaining)       
Computing: [==================                      ] 45%  (~7s remaining)       
Computing: [=====================                   ] 52%  (~6s remaining)       
Computing: [========================                ] 59%  (~5s remaining)       
Computing: [===========================             ] 66%  (~4s remaining)       
Computing: [==============================          ] 73%  (~3s remaining)       
Computing: [================================        ] 80%  (~2s remaining)       
Computing: [====================================    ] 88%  (~1s remaining)       
Computing: [======================================  ] 95%  (~0s remaining)       
Computing: [========================================] 100% (done)                         
#> Stage 2 of 3, evaluate individual candidates...
#> Finished in 15.70 secs
#> Stage 3 of 3, evaluate combination of candidates...
#> Finished in 9.27 mins
predict <- sdts_predict(model, mp_test_data$test$data, round(mean(windows)))
sdts_score(predict, mp_test_data$test$label, 1)
# }