Page 1 of 2

CPAI Coral Detections not working

Posted: Fri Nov 03, 2023 4:10 pm
by almcken
Hello, I have the coral TPU setup and running and working on a raspberry pi. I have tested it and am getting back good results, but the it seems like blue iris isn't taking the results correctly? I am not sure how to descuribe it but when I check the AI debugging I am not seeing the person icons, just circle crossed out logo. See attached image.

Any ideas on what I am doing wrong?
coral1.png
coral1.png (15.59 KiB) Viewed 464423 times
ai settings.png
ai settings.png (25.33 KiB) Viewed 464422 times

Re: CPAI Coral Detections not working

Posted: Sat Nov 11, 2023 2:49 pm
by jensie
I've not started yet with BI. Currently, running Frigate with TPU but thinking of moving. Just saw this post https://github.com/codeproject/CodeProj ... 1675977630
Based on this, it looks like W10 is supported, not sure about W11. On what do you run your environment ?

Re: CPAI Coral Detections not working

Posted: Wed Dec 13, 2023 4:56 pm
by douga
I'm running BI with CodeProject AI on a Windows 11 PC using a Google Coral TPU via a PCIe interface (not USB). The AI is using my Coral TPU, and is frankly quite amazing. Generally analyzing in 13ms - 25ms and have processed over 43,000 requests without crashing or issues. Before the TPU was installed, I was running the AI on my Core i7-9700k CPU which was taking 125ms - 500ms. So the TPU appears to be 10 times faster and draws only a couple of watts doing it. Pretty impressive.

Re: CPAI Coral Detections not working

Posted: Wed Dec 13, 2023 7:55 pm
by cp_sean
almcken wrote: Fri Nov 03, 2023 4:10 pm Hello, I have the coral TPU setup and running and working on a raspberry pi. I have tested it and am getting back good results, but the it seems like blue iris isn't taking the results correctly? I am not sure how to descuribe it but when I check the AI debugging I am not seeing the person icons, just circle crossed out logo. See attached image.
Could you please share your System Info tab from the CodeProject.AI Server dashboard, and any logs you get for these results as well?

Re: CPAI Coral Detections not working

Posted: Wed Dec 13, 2023 9:43 pm
by douga
cp_sean wrote: Wed Dec 13, 2023 7:55 pm
almcken wrote: Fri Nov 03, 2023 4:10 pm Hello, I have the coral TPU setup and running and working on a raspberry pi. I have tested it and am getting back good results, but the it seems like blue iris isn't taking the results correctly? I am not sure how to descuribe it but when I check the AI debugging I am not seeing the person icons, just circle crossed out logo. See attached image.
Could you please share your System Info tab from the CodeProject.AI Server dashboard, and any logs you get for these results as well?
Sure, here you go...
CPAI System Info.JPG
CPAI System Info.JPG (96.8 KiB) Viewed 456417 times
CPAI Log.JPG
CPAI Log.JPG (222.28 KiB) Viewed 456417 times

Re: CPAI Coral Detections not working

Posted: Wed Dec 13, 2023 10:48 pm
by MikeLud
The ObjectDetection (Coral) module does not support custom models only default object detection.

Re: CPAI Coral Detections not working

Posted: Thu Dec 14, 2023 2:10 pm
by douga
MikeLud wrote: Wed Dec 13, 2023 10:48 pm The ObjectDetection (Coral) module does not support custom models only default object detection.
Can you clarify what this means? What is the difference between custom models and default object detection? I didn't notice any differences when switching from my CPU to the TPU in CodeProjectAI (CPAI). It still detects people and cars.

Re: CPAI Coral Detections not working

Posted: Thu Dec 14, 2023 2:36 pm
by MikeLud
Custom models only detect the below compared to default object detection

CodeProject.AI-Custom-IPcam-Models
IPcam-combined Labels: - person, bicycle, car, motorcycle, bus, truck, bird, cat, dog, horse, sheep, cow, bear, deer, rabbit, raccoon, fox, skunk, squirrel, pig

IPcam-general Labels (includes dark models images): - person, vehicle

IPcam-animal Labels: - bird, cat, dog, horse, sheep, cow, bear, deer, rabbit, raccoon, fox, skunk, squirrel, pig

IPcam-dark Labels: - Bicycle, Bus, Car, Cat, Dog, Motorcycle, Person

license-plate Labels: - DayPlate, NightPlate

Plate Label: - Plate


Default Object Detection:
person
bicycle, car, motorbike, aeroplane, bus, train, truck, boat
traffic light, fire hydrant, stop sign, parking meter, bench
cat, dog, horse, sheep, cow, elephant, bear, zebra, giraffe
backpack, umbrella, handbag, tie, suitcase, frisbee, skis, snowboard, sports ball, kite, baseball bat, baseball glove, skateboard, surfboard, tennis racket
bottle, wine glass, cup, fork, knife, spoon, bowl
banana, apple, sandwich, orange, broccoli, carrot, hot dog, pizza, donut, cake
chair, sofa, pottedplant, bed, diningtable, toilet, tvmonitor, laptop, mouse, remote, keyboard, cell phone, microwave, oven, toaster, sink, refrigerator, book, clock, vase, scissors, teddy bear, hair drier, toothbrush

Re: CPAI Coral Detections not working

Posted: Thu Dec 14, 2023 2:41 pm
by douga
MikeLud wrote: Thu Dec 14, 2023 2:36 pm Custom models only detect the below compared to default object detection

CodeProject.AI-Custom-IPcam-Models
IPcam-combined Labels: - person, bicycle, car, motorcycle, bus, truck, bird, cat, dog, horse, sheep, cow, bear, deer, rabbit, raccoon, fox, skunk, squirrel, pig

IPcam-general Labels (includes dark models images): - person, vehicle

IPcam-animal Labels: - bird, cat, dog, horse, sheep, cow, bear, deer, rabbit, raccoon, fox, skunk, squirrel, pig

IPcam-dark Labels: - Bicycle, Bus, Car, Cat, Dog, Motorcycle, Person

license-plate Labels: - DayPlate, NightPlate

Plate Label: - Plate


Default Object Detection:
person
bicycle, car, motorbike, aeroplane, bus, train, truck, boat
traffic light, fire hydrant, stop sign, parking meter, bench
cat, dog, horse, sheep, cow, elephant, bear, zebra, giraffe
backpack, umbrella, handbag, tie, suitcase, frisbee, skis, snowboard, sports ball, kite, baseball bat, baseball glove, skateboard, surfboard, tennis racket
bottle, wine glass, cup, fork, knife, spoon, bowl
banana, apple, sandwich, orange, broccoli, carrot, hot dog, pizza, donut, cake
chair, sofa, pottedplant, bed, diningtable, toilet, tvmonitor, laptop, mouse, remote, keyboard, cell phone, microwave, oven, toaster, sink, refrigerator, book, clock, vase, scissors, teddy bear, hair drier, toothbrush
Thanks Mike. Question for you, do people prefer to use the custom models for better performance? In other words, since the default object detection is looking for more/different objects, is it generally more taxing on the system? What is the benefit of using the custom models over the default?

Re: CPAI Coral Detections not working

Posted: Thu Dec 14, 2023 2:47 pm
by MikeLud
The custom models are faster and have better accuracy. I use ipcam-general on all my cameras.
I am working on a Coral module that will work with custom models.