Page 1 of 1

Database seems corrupted

Posted: Thu Apr 25, 2024 8:09 pm
by Marty_B
Hi All,
I have an issue where much of the footage that Blue Iris has recorded is present on the drives but is not showing up in list when I try to filter by date from the web UI. Again, I can see the files in the hard drives but not from the Blue Iris web UI. I have tried rebuilding the database but this does not seem to help.
I have my storage drives set up as follows:
New C:\Footage Local SSD 90Gb Allocated Move to Stored when full
Stored D:\Footage Local HDD 3500Gb Allocated Move to ExtStored when full
Alerts C:\Alerts Local SSD 115Gb Allocated Move to Stored when full
ExtStored E:\ExtFootage Local HDD 2500Gb Allocated Move to ExtStored2 when full
ExtStored2 F:\ExtFoogage Local HDD 3600Gb Allocated Delete Oldest when full

So I have almost 10 Tb of space but it is not completely full yet. It appears that the database is goofed up and I am unable to repair it. This happened after upgrading to the latest version of Blue Iris.
This is not the first time that this has happened, but this is the first time that a database rebuild did not correct the issue. Any ideas?
Thanks

Re: Database seems corrupted

Posted: Fri Apr 26, 2024 3:43 pm
by Marty_B
Hi All,
I ended up deleting everything in the c:\blueiris\db folder and then rebuilding the database. This seems to have corrected my issue. This process took almost 24 hours on a pretty substantial machine (12th gen I7 with 64Gb of ram and fast SSD) There is about 7 Tb of footage. Is it normal to take so long?
Thanks.

Re: Database seems corrupted

Posted: Fri Apr 26, 2024 3:58 pm
by TimG
With my i7-8700k (16GB RAM) and 16+TB of recordings, deleting and rebuilding the db takes under 30 minutes. That has a 1TB SSD and the rest are rusty platters. Your db rebuild was slow. Anybody else have times for db rebuilds from zero ?

Re: Database seems corrupted

Posted: Fri Apr 26, 2024 7:23 pm
by Marty_B
Wow that is a significant difference. Like yours, my system drive is a 1 TB SSD and the rest are mechanical HDDs, Western digital Purples. The system seems pretty stable now and I will keep an eye on it. Thanks for your information. It helps to know how long other folk's systems take.

Re: Database seems corrupted

Posted: Thu May 30, 2024 6:38 pm
by TimG
Hmm, mine has just taken over 2 hours to recreate it after deleting the database. I even rebooted the pc as it seemed to be rather slow. I think I need to tweak the settings as this has happened since I adjusted the folder sizes.

Re: Database seems corrupted

Posted: Wed Jun 05, 2024 3:32 am
by Rantech
Your problem sounds vaguely reminiscent of a problem I had with BI back about last September. I had a huge database and I don't remember the specific details but your problem sounds like it might be similar. At the time, I believe support suggested using "Combine or Cut" on the record tab and I have been doing so ever since ... that it was more database efficient to combine all the individual clips into larger single files to be saved using this feature. Could be wrong, but I believe this is the advice I was given by support. In any case, I had to purge the entire database and it took forever to rebuild - might have been close to 18 hrs.

There could be significant differences in the time required to rebuild depending on whether people are using this feature or not. Just double checked, my problem was BI losing track of clips it moved from "New" to "Storage"; anything in the cascading folders was not appearing in the database. As it got moved out of the original "New" folder, it disappeared from the databased.

Ultimately, the problem I had was resolved in a later BI update (support advised me it had been resolved so I installed a newer version) and I haven't had an issue since despite now having 20TB of drive and over 1.25 million items in the database.

Are you on a current version of BI or by any chance are you using an older version?

Re: Database seems corrupted

Posted: Wed Jun 05, 2024 5:58 am
by TimG
I am running the latest version. I will have a look at changing those settings as that was unworkable.
If I remember correctly, I had realised that not all clips were available using the calendar selector, so I increased the Alerts folder fron 5GB to 20GB. I have approx 19TB of storage here.