New cameras, old server, lots of hangs
Posted: Wed May 29, 2024 8:54 pm
I have a problem that might be the cameras, but it is puzzling and hope someone can give me a start.
I had BI running at my prior home with 7 cameras, working perfectly (well, except the reolink for its own reasons). These were all 4k, a combination of hikvision, lorex and one reolink.
The server is more than capable, no performance issues.
I moved. I moved the hardware as-is, except that I found a GTX970 I had not remembered and added it to the server (it had an Intel HD530 built in). Otherwise no change but deleting old cameras and adding two new ones. I also upgraded to 5.9.0.7 (from whatever it had been early in 2024 before I started packing to move, not sure, but I stay fairly current with stable).
The new cameras are Empire Tech IPC-T58IR-ZE-S3 and IPC-T54IR-ZE-S3 (so 8mpx and 4mpx but otherwise pretty much identical).
I set them up on the same switch I've used for years, and configured and connected. I set them up as 4fps. The 8mpx hardly worked at all (hanging), the 4mpx seemed to be working, so I reached out to Empire Tech (so far with generic results and waiting for next iteration).
I reset the 8mpx to factory and left it unchanged other than password and IP address. No change (this puts it at 30fps).
But today in reviewing the recordings I see that the 4mpx is not working properly either. As recorded in BI it has hangs, from a second or two to maybe 15 seconds. These hangs are actually in the recordings (I exported some and played back).
On the 8mpx one I see the same hangs in a web view of the camera directly as BI sees.
On the 4mpx one the web view is pretty clean, no hangs. At least none to the eye. I've tried two different computers, I've swapped cables and ports, the issues follow the camera. There are no errors on the switch ports. And at 4fps there's almost no traffic, it's not a network loading issue. Wifi is not involved at any point.
BI is recording directly to disk, not transcoding.
Honestly I think the cameras are sick (though Empire Tech seems well regarded and I have two with similar issues). But I'm hoping someone has suggestions what else to check. I don't even know what other information to put here, so apologies if it is long on words and short on details, but I did not want it to be too very long.
Short list of things tried:
- Reset to factory
- switched cables and ports
- web browser on two different computers (for 8mpx which fails in web browser also)
- did a packet capture on BI server for 8mpx that hangs - no visible problems like timeouts or retransmissions
- restarted BI, restarted the camera many times, did a auto-set of the video parameters in BI several times
- Monitored server for performance issues -- it's barely awake (and it usually ran 7 8mpx cameras and even then was loafing)
Any thoughts what I can be missing? Is there a quick way to roll back just to see if it was the BI version that changed something? (I think that's highly unlikely, it was a minor release).
Linwood
I had BI running at my prior home with 7 cameras, working perfectly (well, except the reolink for its own reasons). These were all 4k, a combination of hikvision, lorex and one reolink.
The server is more than capable, no performance issues.
I moved. I moved the hardware as-is, except that I found a GTX970 I had not remembered and added it to the server (it had an Intel HD530 built in). Otherwise no change but deleting old cameras and adding two new ones. I also upgraded to 5.9.0.7 (from whatever it had been early in 2024 before I started packing to move, not sure, but I stay fairly current with stable).
The new cameras are Empire Tech IPC-T58IR-ZE-S3 and IPC-T54IR-ZE-S3 (so 8mpx and 4mpx but otherwise pretty much identical).
I set them up on the same switch I've used for years, and configured and connected. I set them up as 4fps. The 8mpx hardly worked at all (hanging), the 4mpx seemed to be working, so I reached out to Empire Tech (so far with generic results and waiting for next iteration).
I reset the 8mpx to factory and left it unchanged other than password and IP address. No change (this puts it at 30fps).
But today in reviewing the recordings I see that the 4mpx is not working properly either. As recorded in BI it has hangs, from a second or two to maybe 15 seconds. These hangs are actually in the recordings (I exported some and played back).
On the 8mpx one I see the same hangs in a web view of the camera directly as BI sees.
On the 4mpx one the web view is pretty clean, no hangs. At least none to the eye. I've tried two different computers, I've swapped cables and ports, the issues follow the camera. There are no errors on the switch ports. And at 4fps there's almost no traffic, it's not a network loading issue. Wifi is not involved at any point.
BI is recording directly to disk, not transcoding.
Honestly I think the cameras are sick (though Empire Tech seems well regarded and I have two with similar issues). But I'm hoping someone has suggestions what else to check. I don't even know what other information to put here, so apologies if it is long on words and short on details, but I did not want it to be too very long.
Short list of things tried:
- Reset to factory
- switched cables and ports
- web browser on two different computers (for 8mpx which fails in web browser also)
- did a packet capture on BI server for 8mpx that hangs - no visible problems like timeouts or retransmissions
- restarted BI, restarted the camera many times, did a auto-set of the video parameters in BI several times
- Monitored server for performance issues -- it's barely awake (and it usually ran 7 8mpx cameras and even then was loafing)
Any thoughts what I can be missing? Is there a quick way to roll back just to see if it was the BI version that changed something? (I think that's highly unlikely, it was a minor release).
Linwood