BeeMachine v1.0 model performance

Species list and performance metrics

SpeciesPrecisionRecallError rateF1-scoreNum test imagesNum training images
Bombus affinis0.960.960.040.962631035
B. appositus0.880.900.100.89162715
B. auricomus0.870.920.080.903531369
B. bifarius0.940.920.080.939864037
B. bimaculatus0.890.910.090.9010894352
B. borealis0.930.930.070.934161621
B. caliginosus0.550.680.320.6134109
B. centralis0.800.880.120.843181409
B. citrinus0.860.920.080.89227911
B. crotchii0.870.830.170.8563266
B. cryptarum0.940.920.080.9374316
B. flavidus0.780.830.170.81197742
B. fervidus0.910.860.140.888493430
B. flavifrons0.860.840.160.857303007
B. fraternus0.830.960.040.8970315
B. frigidus0.920.820.180.8728107
B. griseocollis0.940.960.040.9513895277
B. huntii0.930.910.090.926522427
B. impatiens0.970.930.070.9520207988
B. insularis0.770.930.070.84204977
B. melanopygus0.940.930.070.939133575
B. mixtus0.880.910.090.905862409
B. morrisoni0.890.920.080.9152211
B. nevadensis0.950.930.070.943801478
B. occidentalis0.960.910.090.93188726
B. pensylvanicus0.950.950.050.9511724539
B. perplexus0.910.930.070.924681827
B. rufocinctus0.850.770.230.817893098
B. sandersoni0.550.630.370.5938111
B. sitkensis0.680.700.300.69109469
B. sylvicola0.620.740.260.6761254
B. ternarius0.940.950.050.9410644453
B. terricola0.940.940.060.943601481
B. vagans0.790.850.150.825202152
B. vandykei0.750.720.280.7381340
B. vosnesenskii0.960.960.040.9610514287

Confusion matrix

A confusion matrix shows the relationship between true and predicted values. For example, with 2020 test images, B. impatiens was correctly classified 1888 times. It was most frequently confused with B. bimaculatus (54 times) and B. griseocollis (43 times). Likewise, the species most often confused for B. bimaculatus and B. griseocollis was B. impatiens (21 and 13 times respectively).