djl
Pose estimation example
Pose estimation is a computer vision technique for determining the pose of an object in an image.
In this example, you learn how to implement inference code with a ModelZoo model to detect people and their joints in an image.
The source code can be found at PoseEstimation.java.
Setup guide
Follow setup to configure your development environment.
Run pose estimation example
Input image file
You can find the image used in this example in the project test resource folder: src/test/resources/pose_soccer.jpg
Build the project and run
Use the following command to run the project:
cd examples
./gradlew run -Dmain=ai.djl.examples.inference.PoseEstimation
Your output should look like the following:
[INFO ] - Pose image has been saved in: build/output/joints-0.png
[INFO ] - Pose image has been saved in: build/output/joints-1.png
[INFO ] - Pose image has been saved in: build/output/joints-2.png
[INFO ] - [
[
{"Joint": {"x"=0.333, "y"=0.063}, "confidence": 0.6940},
{"Joint": {"x"=0.333, "y"=0.031}, "confidence": 0.7182},
{"Joint": {"x"=0.354, "y"=0.047}, "confidence": 0.4949},
{"Joint": {"x"=0.354, "y"=0.047}, "confidence": 0.9011},
{"Joint": {"x"=0.458, "y"=0.031}, "confidence": 0.8790},
{"Joint": {"x"=0.375, "y"=0.172}, "confidence": 0.8546},
{"Joint": {"x"=0.542, "y"=0.156}, "confidence": 0.8659},
{"Joint": {"x"=0.417, "y"=0.313}, "confidence": 0.7731},
{"Joint": {"x"=0.625, "y"=0.328}, "confidence": 0.9211},
{"Joint": {"x"=0.458, "y"=0.500}, "confidence": 0.7541},
{"Joint": {"x"=0.542, "y"=0.359}, "confidence": 0.5837},
{"Joint": {"x"=0.458, "y"=0.469}, "confidence": 0.6387},
{"Joint": {"x"=0.563, "y"=0.469}, "confidence": 0.6686},
{"Joint": {"x"=0.271, "y"=0.703}, "confidence": 0.8583},
{"Joint": {"x"=0.625, "y"=0.719}, "confidence": 0.8233},
{"Joint": {"x"=0.125, "y"=0.969}, "confidence": 0.7007},
{"Joint": {"x"=0.958, "y"=0.844}, "confidence": 0.7480}
],
[
{"Joint": {"x"=0.354, "y"=0.125}, "confidence": 0.8993},
{"Joint": {"x"=0.375, "y"=0.109}, "confidence": 0.9235},
{"Joint": {"x"=0.354, "y"=0.109}, "confidence": 0.8176},
{"Joint": {"x"=0.438, "y"=0.094}, "confidence": 0.9242},
{"Joint": {"x"=0.458, "y"=0.094}, "confidence": 0.6368},
{"Joint": {"x"=0.500, "y"=0.156}, "confidence": 0.8452},
{"Joint": {"x"=0.688, "y"=0.156}, "confidence": 0.6121},
{"Joint": {"x"=0.479, "y"=0.250}, "confidence": 0.9007},
{"Joint": {"x"=0.854, "y"=0.234}, "confidence": 0.7352},
{"Joint": {"x"=0.208, "y"=0.250}, "confidence": 0.7154},
{"Joint": {"x"=0.958, "y"=0.313}, "confidence": 0.5030},
{"Joint": {"x"=0.625, "y"=0.484}, "confidence": 0.6673},
{"Joint": {"x"=0.500, "y"=0.500}, "confidence": 0.7583},
{"Joint": {"x"=0.708, "y"=0.719}, "confidence": 0.7621},
{"Joint": {"x"=0.271, "y"=0.641}, "confidence": 0.8008},
{"Joint": {"x"=0.250, "y"=0.906}, "confidence": 0.8605}
],
[
{"Joint": {"x"=0.271, "y"=0.156}, "confidence": 0.8428},
{"Joint": {"x"=0.292, "y"=0.141}, "confidence": 0.8469},
{"Joint": {"x"=0.271, "y"=0.125}, "confidence": 0.8029},
{"Joint": {"x"=0.333, "y"=0.141}, "confidence": 0.9200},
{"Joint": {"x"=0.354, "y"=0.141}, "confidence": 0.4879},
{"Joint": {"x"=0.542, "y"=0.250}, "confidence": 0.8573},
{"Joint": {"x"=0.292, "y"=0.250}, "confidence": 0.8553},
{"Joint": {"x"=0.771, "y"=0.359}, "confidence": 0.9046},
{"Joint": {"x"=0.167, "y"=0.391}, "confidence": 0.6416},
{"Joint": {"x"=0.854, "y"=0.469}, "confidence": 0.9166},
{"Joint": {"x"=0.188, "y"=0.359}, "confidence": 0.6091},
{"Joint": {"x"=0.458, "y"=0.563}, "confidence": 0.5665},
{"Joint": {"x"=0.375, "y"=0.563}, "confidence": 0.5728},
{"Joint": {"x"=0.146, "y"=0.750}, "confidence": 0.6888},
{"Joint": {"x"=0.667, "y"=0.766}, "confidence": 0.7807},
{"Joint": {"x"=0.000, "y"=0.938}, "confidence": 0.2272},
{"Joint": {"x"=0.396, "y"=0.828}, "confidence": 0.4885}
]]
Output images with the detected joints for each person will be saved in the build/output directory:
