isaaccorley/ftw-prue-ccby

Runs using the PRUE EfficientNet configs but with training w/o only on CC-BY countries.

Metrics were computed on the FTW Full dataset using ftw model test -p3 -t3 --temporal_options stacked --model path/to/model.ckpt --countries full_data

Model	Pixel Level IoU	Pixel Level Precision	Pixel Level Recall	Object Level Precision	Object Level Recall	Object Level F1
EfficientNet-B3	0.76	0.87	0.86	0.54	0.31	0.39
EfficientNet-B5	0.76	0.88	0.86	0.53	0.33	0.41
EfficientNet-B7	0.77	0.88	0.86	0.58	0.35	0.44

Here are the CC-BY-NC checkpoint metrics from the paper for reference:

Model	Pixel Level IoU	Pixel Level Precision	Pixel Level Recall	Object Level Precision	Object Level Recall	Object Level F1
EfficientNet-B3	0.74	-	-	-	-	0.43
EfficientNet-B5	0.75	-	-	-	-	0.46
EfficientNet-B7	0.76	0.89	0.83	0.62	0.40	0.47