Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,78 @@
|
|
| 1 |
-
---
|
| 2 |
-
license:
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_link: >-
|
| 4 |
+
https://github.st.com/AIS/stm32ai-modelzoo/raw/master/object_detection/LICENSE.md
|
| 5 |
+
pipeline_tag: object-detection
|
| 6 |
+
---
|
| 7 |
+
# BlazeFace Front 128x128 Quantized
|
| 8 |
+
|
| 9 |
+
## **Use case** : `Object detection`
|
| 10 |
+
|
| 11 |
+
# Model description
|
| 12 |
+
|
| 13 |
+
BlazeFace Front 128x128 is a lightweight and efficient face detection model optimized for real-time applications on embedded devices. It is a variant of the BlazeFace architecture, designed specifically for detecting frontal faces at a resolution of 128x128 pixels. The model is quantized to int8 format using TensorFlow Lite converter to reduce memory footprint and improve inference speed on resource-constrained hardware.
|
| 14 |
+
|
| 15 |
+
BlazeFace is known for its fast inference and accuracy, making it suitable for applications such as face tracking, augmented reality, and user authentication.
|
| 16 |
+
|
| 17 |
+
## Network information
|
| 18 |
+
|
| 19 |
+
| Network information | Value |
|
| 20 |
+
|------------------------|-----------------|
|
| 21 |
+
| Framework | TensorFlow Lite |
|
| 22 |
+
| Quantization | int8 |
|
| 23 |
+
| Input resolution | 128x128 |
|
| 24 |
+
| Provenance | https://github.com/PINTO0309/PINTO_model_zoo/tree/main/030_BlazeFace |
|
| 25 |
+
|
| 26 |
+
## Network inputs / outputs
|
| 27 |
+
|
| 28 |
+
| Input Shape | Description |
|
| 29 |
+
|-------------|-------------|
|
| 30 |
+
| (1, 128, 128, 3) | Single 128x128 RGB image with FLOAT32 values between -1 and 1 |
|
| 31 |
+
|
| 32 |
+
| Output Shape | Description |
|
| 33 |
+
|--------------|-------------|
|
| 34 |
+
| (1, 512, 16) | FLOAT32 tensor containing bounding box coordinates and keypointss for detected faces |
|
| 35 |
+
| (1, 512, 1) | FLOAT32 tensor containing confidence scores for detected faces |
|
| 36 |
+
| (1, 384, 16) | FLOAT32 tensor containing bounding box coordinates and keypointss for detected faces |
|
| 37 |
+
| (1, 384, 1) | FLOAT32 tensor containing confidence scores for detected faces |
|
| 38 |
+
|
| 39 |
+
## Recommended Platforms
|
| 40 |
+
|
| 41 |
+
| Platform | Supported | Recommended |
|
| 42 |
+
|----------|-----------|-------------|
|
| 43 |
+
| STM32L0 | [] | [] |
|
| 44 |
+
| STM32L4 | [] | [] |
|
| 45 |
+
| STM32U5 | [] | [] |
|
| 46 |
+
| STM32H7 | [] | [] |
|
| 47 |
+
| STM32MP1 | [] | [] |
|
| 48 |
+
| STM32MP2 | [] | [] |
|
| 49 |
+
| STM32N6 | [x] | [x] |
|
| 50 |
+
|
| 51 |
+
## Performances
|
| 52 |
+
|
| 53 |
+
### Metrics
|
| 54 |
+
|
| 55 |
+
Performance metrics are measured using default STM32Cube.AI configurations with input/output allocated buffers.
|
| 56 |
+
|
| 57 |
+
| Model | Dataset | Format | Resolution | Series | Internal RAM (KB) | External RAM (KB) | Weights Flash (KB) | STM32Cube.AI version | STEdgeAI Core version |
|
| 58 |
+
|----------------------|---------------|--------|------------|---------|-------------------|-------------------|--------------------|----------------------|-----------------------|
|
| 59 |
+
| [BlazeFace Front 128x128 per channel](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/object_detection/face_detect_front/Public_pretrainedmodel_public_dataset/wider_face/blazeface_front_128_quant_pc_ff_od_wider_face.tflite) | WIDER FACE (frontal) | Int8 | 128x128x3 | STM32N6 | 528 | 0 | 150.97 | 10.2.0 | 2.2.0 |
|
| 60 |
+
|
| 61 |
+
### Reference **NPU** inference time (example)
|
| 62 |
+
|
| 63 |
+
| Model | Dataset | Format | Resolution | Board | Execution Engine | Inference time (ms) | Inf / sec | STM32Cube.AI version | STEdgeAI Core version |
|
| 64 |
+
|----------------------|---------------|--------|------------|----------------|------------------|---------------------|-----------|----------------------|-----------------------|
|
| 65 |
+
| [BlazeFace Front 128x128 per channel](https://github.com/STMicroelectronics/stm32ai-modelzoo/tree/main/object_detection/face_detect_front/Public_pretrainedmodel_public_dataset/wider_face/blazeface_front_128_quant_pc_ff_od_wider_face.tflite) | WIDER FACE (frontal) | Int8 | 128x128x3 | STM32N6570-DK | NPU/MCU | 5.09 | 196.3 | 10.2.0 | 2.2.0 |
|
| 66 |
+
|
| 67 |
+
|
| 68 |
+
## Integration and support
|
| 69 |
+
|
| 70 |
+
For integration examples and additional services, please refer to the STM32 AI model zoo services repository:
|
| 71 |
+
[https://github.com/STMicroelectronics/stm32ai-modelzoo-services](https://github.com/STMicroelectronics/stm32ai-modelzoo-services)
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
## References
|
| 75 |
+
|
| 76 |
+
- BlazeFace paper: [https://arxiv.org/abs/1907.05047](https://arxiv.org/abs/1907.05047)
|
| 77 |
+
- MediaPipe BlazeFace model repository: [https://github.com/PINTO0309/PINTO_model_zoo/tree/main/030_BlazeFace](https://github.com/PINTO0309/PINTO_model_zoo/tree/main/030_BlazeFace)
|
| 78 |
+
- WIDER FACE dataset: [http://shuoyang1213.me/WIDERFACE/](http://shuoyang1213.me/WIDERFACE/)
|