Blue Iris

Re: Coral TPU really does its work for CP.AI object recognition!

2024-07-06T15:59:59+00:00

Hi all,
i've tried using Coral on my PC.
Consider that i'm using a mini PC with a i7-10510U CPU.I have 9 camera: 7 are 4k, one 5MP and one 3MP. Codec is h265/h265+
Using Coral i can't seee any improvementif chek statistics in blue iris.
CPU is always at 100% of use and Temeprature is arount 85-90°C!

You have checked CP.AI is actually using it, not just installed? And it's preferred to use substream for all motion recognition on BlueIris, because full resolution stream taxes unnecessarily cpu and offers no benefits for motion detection etc. Coral helps CP.AI to confirm initial detection by BI. Seems that your system is misconfigured/not working properly, unless you are living in some very populated place with lot of motion.

Statistics: Posted by honkkis — Sat Jul 06, 2024 3:59 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2024-07-06T15:52:09+00:00

Just for all who wants to figure this out. You need to or uninstall and install the module multiple times or restart your windows machine.
You should get the following in the logs
Code:
objectdetection_coral_adapter.py: Edge TPU detected
If you get
Code:
objectdetection_coral_adapter.py: has exited
reinstall the module or restart your windows machine

That's exactly the solution recommended by CP.AI, re-install until it works. It's not elegant or stylish, but seems to work.

Just ordered dual TPU version of card, in order to try more complex things. So far, really happy with my systems performance (and power consumption!) with Coral M.2! Seems to get more AI-models too to experiment.

Statistics: Posted by honkkis — Sat Jul 06, 2024 3:52 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2024-03-11T16:44:08+00:00

Hi all,
i've tried using Coral on my PC.
Consider that i'm using a mini PC with a i7-10510U CPU.I have 9 camera: 7 are 4k, one 5MP and one 3MP. Codec is h265/h265+
Using Coral i can't seee any improvementif chek statistics in blue iris.
CPU is always at 100% of use and Temeprature is arount 85-90°C!

Statistics: Posted by Manu87 — Mon Mar 11, 2024 4:44 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-12-07T20:27:22+00:00

Good info. Thank you.

Statistics: Posted by TimG — Thu Dec 07, 2023 8:27 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-12-07T13:12:30+00:00

Just for all who wants to figure this out. You need to or uninstall and install the module multiple times or restart your windows machine.
You should get the following in the logs

Code:

objectdetection_coral_adapter.py: Edge TPU detected

If you get

Code:

objectdetection_coral_adapter.py: has exited

reinstall the module or restart your windows machine

Statistics: Posted by jensie — Thu Dec 07, 2023 1:12 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-12-07T06:47:21+00:00

Did someone figure this out in the end ?

Statistics: Posted by jensie — Thu Dec 07, 2023 6:47 am

Re: Coral TPU really does its work for CP.AI object recognition!

2023-11-11T14:53:01+00:00

Excellent info. Could you do a write up on how to install it and get it working too ? Software side only - if somebody doesn't know how to install an M2 card they should read up on that first
Installation was very straightforward and fast, just followed Getting started directions from Coral.ai: (chapter 2b) https://coral.ai/docs/m2/get-started/

After installing Microsoft Visual C++ 2019 redistributable and edgetpu_runtime_20221024.zip Coral appears in Windows Device manager as Coral accelerator devices / Coral PCIe accelerator and is ready to use for Codeproject.AI. Remember to run edgetpu-installer as administrator, just to make sure there will be no permission management problems. Windows might show popup about untrusted software publisher at installation stage, just allow it (if you turst Google, that is).

Edgetpu-installer is simple old-school command-line bat-file, it asks only if you want to run Coral at half-speed or full-speed and that's it. But it works.

In CodeProject.AI Server control panel (the web page) in Install Modules tab it's required to install Object Detection (Coral)-module. CP.AI defaults properly module to Edge TPU, user needs really only to choose model size, if other than tiny is desired. Tiny and Small are more than adequate.

I didn't do step 3 from Coral.ai instructions (PyCoral library installation). Installation of PyCoral library and associated TensorFlow Lite might allow (?) using ObjectDetection(TF-Lite) on CP.AI, it's there as option in installable modules.

After installing Coral software and CP.AI with Object Detection(Coral), rest of the config is normal BlueIris AI-configuration, which is well described.

I do have quite advacnced skills on IT in general, but definitely I'm not expert on AI, CP.AI or Python and yet I got this working in minutes, so I would say this is not "advanced project" in traditional sense.

To summarize:
1. Surf to https://coral.ai/docs/m2/get-started/
2. Read instructons (2b)
3. Download and setup Microsoft Visual C++ 2019 redistributable
4. Download and setup edgetpu_runtime_20221024.zip (remember to admin and allow unsigned publisher)
5. Make sure Coral accelerator is shown in Windows Device manager
6. Add Object Detection(Coral)-module to CodeProject.AI modules and enable. Choose model size.
7. Config your BlueIris per instructions on this (and CP.AI) site.
8. Enjoy stable, reliable and power-efficient object-recognition benefits on BlueIris!

As usual, if there's problem, restart. If installer suggests restart, do it.

How does your environment look like ? You are running it on a dedicated machine ? And what windows version are you using ?

Statistics: Posted by jensie — Sat Nov 11, 2023 2:53 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-10-31T19:37:15+00:00

Hey did you ever figure this out? im having the same problem

Have you taken look at this Codeproject AI troubleshooting (Readme if you are having issues)?
https://www.codeproject.com/Feature/Cod ... sions.aspx

Some people suggest removing and then reinstalling CP.AI on Reddit, CP.AI page (above) suggests installing single missing module is possible.

Statistics: Posted by honkkis — Tue Oct 31, 2023 7:37 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-10-22T00:04:33+00:00

Excellent info. Could you do a write up on how to install it and get it working too ? Software side only - if somebody doesn't know how to install an M2 card they should read up on that first
Installation was very straightforward and fast, just followed Getting started directions from Coral.ai: (chapter 2b) https://coral.ai/docs/m2/get-started/

After installing Microsoft Visual C++ 2019 redistributable and edgetpu_runtime_20221024.zip Coral appears in Windows Device manager as Coral accelerator devices / Coral PCIe accelerator and is ready to use for Codeproject.AI. Remember to run edgetpu-installer as administrator, just to make sure there will be no permission management problems. Windows might show popup about untrusted software publisher at installation stage, just allow it (if you turst Google, that is).

Edgetpu-installer is simple old-school command-line bat-file, it asks only if you want to run Coral at half-speed or full-speed and that's it. But it works.

In CodeProject.AI Server control panel (the web page) in Install Modules tab it's required to install Object Detection (Coral)-module. CP.AI defaults properly module to Edge TPU, user needs really only to choose model size, if other than tiny is desired. Tiny and Small are more than adequate.

I didn't do step 3 from Coral.ai instructions (PyCoral library installation). Installation of PyCoral library and associated TensorFlow Lite might allow (?) using ObjectDetection(TF-Lite) on CP.AI, it's there as option in installable modules.

After installing Coral software and CP.AI with Object Detection(Coral), rest of the config is normal BlueIris AI-configuration, which is well described.

I do have quite advacnced skills on IT in general, but definitely I'm not expert on AI, CP.AI or Python and yet I got this working in minutes, so I would say this is not "advanced project" in traditional sense.

To summarize:
1. Surf to https://coral.ai/docs/m2/get-started/
2. Read instructons (2b)
3. Download and setup Microsoft Visual C++ 2019 redistributable
4. Download and setup edgetpu_runtime_20221024.zip (remember to admin and allow unsigned publisher)
5. Make sure Coral accelerator is shown in Windows Device manager
6. Add Object Detection(Coral)-module to CodeProject.AI modules and enable. Choose model size.
7. Config your BlueIris per instructions on this (and CP.AI) site.
8. Enjoy stable, reliable and power-efficient object-recognition benefits on BlueIris!

As usual, if there's problem, restart. If installer suggests restart, do it.
Thanks for posting this. I folowed your steps but i dont think its working. Any ideas?
On the logs i see:
08:33:57:Started ObjectDetection (Coral) module
08:33:57:objectdetection_coral_adapter.py: Traceback (most recent call last):
08:33:57:objectdetection_coral_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 10, in
08:33:57:objectdetection_coral_adapter.py: from module_runner import ModuleRunner
08:33:58:objectdetection_coral_adapter.py: File "../../SDK/Python\module_runner.py", line 28, in
08:33:58:objectdetection_coral_adapter.py: import aiohttp
08:33:58:objectdetection_coral_adapter.py: ModuleNotFoundError: No module named 'aiohttp'
08:33:58:Module ObjectDetectionCoral has shutdown
08:33:58:objectdetection_coral_adapter.py: has exited

I also notice that next to ObjectDetection (Coral) it shows CPU and not GPU(TPU).

Hey did you ever figure this out? im having the same problem

Statistics: Posted by blktbss07 — Sun Oct 22, 2023 12:04 am

Re: Coral TPU really does its work for CP.AI object recognition!

2023-10-13T15:36:12+00:00

Excellent info. Could you do a write up on how to install it and get it working too ? Software side only - if somebody doesn't know how to install an M2 card they should read up on that first
Installation was very straightforward and fast, just followed Getting started directions from Coral.ai: (chapter 2b) https://coral.ai/docs/m2/get-started/

After installing Microsoft Visual C++ 2019 redistributable and edgetpu_runtime_20221024.zip Coral appears in Windows Device manager as Coral accelerator devices / Coral PCIe accelerator and is ready to use for Codeproject.AI. Remember to run edgetpu-installer as administrator, just to make sure there will be no permission management problems. Windows might show popup about untrusted software publisher at installation stage, just allow it (if you turst Google, that is).

Edgetpu-installer is simple old-school command-line bat-file, it asks only if you want to run Coral at half-speed or full-speed and that's it. But it works.

In CodeProject.AI Server control panel (the web page) in Install Modules tab it's required to install Object Detection (Coral)-module. CP.AI defaults properly module to Edge TPU, user needs really only to choose model size, if other than tiny is desired. Tiny and Small are more than adequate.

I didn't do step 3 from Coral.ai instructions (PyCoral library installation). Installation of PyCoral library and associated TensorFlow Lite might allow (?) using ObjectDetection(TF-Lite) on CP.AI, it's there as option in installable modules.

After installing Coral software and CP.AI with Object Detection(Coral), rest of the config is normal BlueIris AI-configuration, which is well described.

I do have quite advacnced skills on IT in general, but definitely I'm not expert on AI, CP.AI or Python and yet I got this working in minutes, so I would say this is not "advanced project" in traditional sense.

To summarize:
1. Surf to https://coral.ai/docs/m2/get-started/
2. Read instructons (2b)
3. Download and setup Microsoft Visual C++ 2019 redistributable
4. Download and setup edgetpu_runtime_20221024.zip (remember to admin and allow unsigned publisher)
5. Make sure Coral accelerator is shown in Windows Device manager
6. Add Object Detection(Coral)-module to CodeProject.AI modules and enable. Choose model size.
7. Config your BlueIris per instructions on this (and CP.AI) site.
8. Enjoy stable, reliable and power-efficient object-recognition benefits on BlueIris!

As usual, if there's problem, restart. If installer suggests restart, do it.

Thanks for posting this. I folowed your steps but i dont think its working. Any ideas?
On the logs i see:
08:33:57:Started ObjectDetection (Coral) module
08:33:57:objectdetection_coral_adapter.py: Traceback (most recent call last):
08:33:57:objectdetection_coral_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 10, in
08:33:57:objectdetection_coral_adapter.py: from module_runner import ModuleRunner
08:33:58:objectdetection_coral_adapter.py: File "../../SDK/Python\module_runner.py", line 28, in
08:33:58:objectdetection_coral_adapter.py: import aiohttp
08:33:58:objectdetection_coral_adapter.py: ModuleNotFoundError: No module named 'aiohttp'
08:33:58:Module ObjectDetectionCoral has shutdown
08:33:58:objectdetection_coral_adapter.py: has exited

I also notice that next to ObjectDetection (Coral) it shows CPU and not GPU(TPU).

Statistics: Posted by dangerdan — Fri Oct 13, 2023 3:36 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-09-02T17:12:47+00:00

Thank you

Statistics: Posted by TimG — Sat Sep 02, 2023 5:12 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-09-02T17:02:22+00:00

Excellent info. Could you do a write up on how to install it and get it working too ? Software side only - if somebody doesn't know how to install an M2 card they should read up on that first

Installation was very straightforward and fast, just followed Getting started directions from Coral.ai: (chapter 2b) https://coral.ai/docs/m2/get-started/

After installing Microsoft Visual C++ 2019 redistributable and edgetpu_runtime_20221024.zip Coral appears in Windows Device manager as Coral accelerator devices / Coral PCIe accelerator and is ready to use for Codeproject.AI. Remember to run edgetpu-installer as administrator, just to make sure there will be no permission management problems. Windows might show popup about untrusted software publisher at installation stage, just allow it (if you turst Google, that is).

Edgetpu-installer is simple old-school command-line bat-file, it asks only if you want to run Coral at half-speed or full-speed and that's it. But it works.

In CodeProject.AI Server control panel (the web page) in Install Modules tab it's required to install Object Detection (Coral)-module. CP.AI defaults properly module to Edge TPU, user needs really only to choose model size, if other than tiny is desired. Tiny and Small are more than adequate.

I didn't do step 3 from Coral.ai instructions (PyCoral library installation). Installation of PyCoral library and associated TensorFlow Lite might allow (?) using ObjectDetection(TF-Lite) on CP.AI, it's there as option in installable modules.

After installing Coral software and CP.AI with Object Detection(Coral), rest of the config is normal BlueIris AI-configuration, which is well described.

I do have quite advacnced skills on IT in general, but definitely I'm not expert on AI, CP.AI or Python and yet I got this working in minutes, so I would say this is not "advanced project" in traditional sense.

To summarize:
1. Surf to https://coral.ai/docs/m2/get-started/
2. Read instructons (2b)
3. Download and setup Microsoft Visual C++ 2019 redistributable
4. Download and setup edgetpu_runtime_20221024.zip (remember to admin and allow unsigned publisher)
5. Make sure Coral accelerator is shown in Windows Device manager
6. Add Object Detection(Coral)-module to CodeProject.AI modules and enable. Choose model size.
7. Config your BlueIris per instructions on this (and CP.AI) site.
8. Enjoy stable, reliable and power-efficient object-recognition benefits on BlueIris!

As usual, if there's problem, restart. If installer suggests restart, do it.

Statistics: Posted by honkkis — Sat Sep 02, 2023 5:02 pm

Re: Coral TPU really does its work for CP.AI object recognition!

2023-09-02T10:46:16+00:00

Excellent info. Could you do a write up on how to install it and get it working too ? Software side only - if somebody doesn't know how to install an M2 card they should read up on that first

Statistics: Posted by TimG — Sat Sep 02, 2023 10:46 am

Coral TPU really does its work for CP.AI object recognition!

2023-09-02T10:22:21+00:00

Installed Coral m.2 board (single TPU A+E key) couple days ago into my AsRock Deskmini A300 (using Ryzen 3 3200G) and boy, Coral is a little miracle! I had a Coral USB for few months, but it was having certain issues (frequent CP.AI crashes), can't say if it was due to Coral USB-stick itself or CP.Ai, however m.2 Coral is rock solid on same configuration! Object recognition times vary slighlty, but average seems to be around 70ms to 75ms (model size small). Not bad for very compact camera server and cheap TPU!

Of course one could use cheap CUDA-cards, but power consumption and computers physical size would grow a lot compared to DeskMini (it's Mini-STX after all). DeskMini has two M.2 slots, one PCIe Gen3 x4 for SSD and second Gen3 x2/4x for wifi, using wifi slot for Coral, other m.2 has my system disk and I have conventional 2.5" 7200rpm SATA HDD for videostorage. Using this setup with 3pcs 3MP, 1pc 4Mp and single 8k camera with direct disc recording and substream motion analysis BI uses CPU about 2% to 3% on average.

Coral was earlier difficult to obtain, but it can be nowadays bought around its recommended price (25USD / EUR) and I got my m.2 version in a week from a German retailer.

Coral m.2 seems very reasonable and well working solution for systems with m.2 slots. It really allows ultra compact and power efficient computers to use AI.

Statistics: Posted by honkkis — Sat Sep 02, 2023 10:22 am