Storage and clips don't delete as configured

General discussion about Blue Iris
scottlindner
Posts: 23
Joined: Mon Aug 07, 2023 3:37 pm

Re: Storage and clips don't delete as configured

Post by scottlindner »

I wonder if the default settings just don't work and I need to set it up to do all of this moving business. I do not need sophisticated at all. I just want the most recent that fits on my drive whatever that is. But now this has me thinking that it won't work right out of the box until you muck about with moving it from folder to folder to folder which just seems complicated to me but I'll give it a try.
User avatar
Pogo
Posts: 528
Joined: Tue Jul 18, 2023 7:21 pm
Location: Reportedly in the Area

Re: Storage and clips don't delete as configured

Post by Pogo »

scottlindner wrote: Sat Jan 20, 2024 8:35 pm I wonder if the default settings just don't work and I need to set it up to do all of this moving business.
You at least need to tell Blue Iris where to put things and how long to store stuff before it does something with it. It doesn't know by default.

There are instructions. I suggest starting with the help file link in Tim's sig.

If visual instruction works better, go here:

https://www.youtube.com/watch?v=7veBRr6msbk&t=344s
User avatar
TimG
Posts: 2391
Joined: Tue Jun 18, 2019 10:45 am
Location: Nottinghamshire, UK.

Re: Storage and clips don't delete as configured

Post by TimG »

But now this has me thinking that it won't work right out of the box until you muck about with moving it from folder to folder to folder which just seems complicated to me but I'll give it a try.
You don't need to move it at all if you don't want to as you can simply use one folder. My system just grew another hard drive, so I cascaded the clip files between three drives, and moved the delete to the last drive. It's not the best way of doing things as it keeps moving files.

Pogo is correct. I am trying to prove that you have set up BI5 to use your specified folders. If this has not been done, BI5 cannot control the folders. We really need this basic info otherwise we are making assumptions.

I asked earlier which folder on the left you clicked to see your F:\BlueIris\archive folder. You have this:

Screenshot 2024-01-21 100836.png
Screenshot 2024-01-21 100836.png (64.17 KiB) Viewed 4096 times
BI5 will by default record to "New" which it probably puts on your C: drive. That can be verified by clicking on "New" in the folder list on the left and looking at the file path on the right. Which folder on the left do you click on to see F:\BlueIris\archive ?

Note also in the storage graphics above that it states which folders are on which drives. Once again, this is proving that BI5 knows where they are and can control them.
Forum Moderator.
Problem ? Ask and we will try to assist, but please check the Help file.
User avatar
Pogo
Posts: 528
Joined: Tue Jul 18, 2023 7:21 pm
Location: Reportedly in the Area

Re: Storage and clips don't delete as configured

Post by Pogo »

TimG wrote: Sun Jan 21, 2024 10:27 am I asked earlier which folder on the left you clicked to see your F:\BlueIris\archive folder.
Perhaps this is all being attempted using TreeSize and not via the Blue Iris structure, hence Blue Iris not having its own folder associations except 'New'?
scottlindner
Posts: 23
Joined: Mon Aug 07, 2023 3:37 pm

Re: Storage and clips don't delete as configured

Post by scottlindner »

TimG wrote: Sun Jan 21, 2024 10:27 am Which folder on the left do you click on to see F:\BlueIris\archive ?
"New" is highlighted in the screenshot. That is the folder that is selected.
scottlindner
Posts: 23
Joined: Mon Aug 07, 2023 3:37 pm

Re: Storage and clips don't delete as configured

Post by scottlindner »

Pogo wrote: Sun Jan 21, 2024 2:28 pm
TimG wrote: Sun Jan 21, 2024 10:27 am I asked earlier which folder on the left you clicked to see your F:\BlueIris\archive folder.
Perhaps this is all being attempted using TreeSize and not via the Blue Iris structure, hence Blue Iris not having its own folder associations except 'New'?
TreeSize just visualizes disk usage. Only BI can control where BI is putting files or deleting them. It was requested earlier up in the discussion to see what is using my disk space to determine if other things are on this disk
scottlindner
Posts: 23
Joined: Mon Aug 07, 2023 3:37 pm

Re: Storage and clips don't delete as configured

Post by scottlindner »

I made some big changes and had to let it run for a long time and the same issue is happening again. I know because the BI app on my phone no longer shows "new" alerts for any cameras. They're all obviously old.

I thought for sure this time I would have it beat because I am moving things between folders and also added clip age and am using my NAS as a spill over just so there is a target to move stuff to that has generous space available. I'm still having the same issue where BI doesn't appear to be doing anything at all based on these settings.

"New" folder settings. I reduced the "Limit size" value hoping there is some funny math going on even though the F drive isa 6TB disk. I also changed it to move to Stored which I'm assuming is the action for when either the Limit size or Limit clip age is triggered for any file.
BI Settings Storage New.png
BI Settings Storage New.png (43.58 KiB) Viewed 3386 times
"Stored" folder settings I didn't have before. I have a NAS with a ton of extra storage so I decided I'll use it as a spill over at least until I sort out what's going on.
BI Settings Storage Stored.png
BI Settings Storage Stored.png (43.67 KiB) Viewed 3386 times
The usage on my C drive which is just the OS, BI, and the BI database (based on a recommendation after my last update).
C Drive.png
C Drive.png (134.94 KiB) Viewed 3386 times

I didn't realize there was a three file attachment limit so I'll continue in another response.
scottlindner
Posts: 23
Joined: Mon Aug 07, 2023 3:37 pm

Re: Storage and clips don't delete as configured

Post by scottlindner »

Continued from previous response...

My F drive showing it's just BI using it and nothing else.
  • You can see the New folder has 5.3TB used but in BI I have it configured to use no more than 4.2TB.
    If I open up the F:\BlueIris\New folder the newest files are of course dated today and the oldest are dated Jan 20th which is 40 days ago but in BI I have it set to no more than 14 days.
F Drive.png
F Drive.png (98.44 KiB) Viewed 3453 times
And just to show that my Stored folder is being used on the NAS after setting this up
NAS Stored Folder.png
NAS Stored Folder.png (54.44 KiB) Viewed 3453 times
What is interesting is I looked at both folders and they have files spanning all dates from the last time I updated on this and deleted all files and started with a fresh database just to make sure I wasn't confusing BI with files it didn't know about or files it thought it had but didn't. But what is interesting is that there is no apparent rhyme or reason for when a file is moved or not. At first I was thinking maybe some cameras are being moved and others aren't. Or then by file size thinking the move from one file system to another might trigger some change in performance and timeout inside of BI. But it just appears to be random.

So now I have a thought and this is hard to figure out without a ton of research. Is BI not moving files that have an alert in the history?
User avatar
Pogo
Posts: 528
Joined: Tue Jul 18, 2023 7:21 pm
Location: Reportedly in the Area

Re: Storage and clips don't delete as configured

Post by Pogo »

The "no rhyme or reason" aspect is likely due to age limits being applied. It applies to each clip individually and can indeed seem random as a result..., at least at a glance. As previously mentioned, some folks use it and some don't for any number of reasons. And the directory structure seemed to be all over the place.

One noticeable change in your structure is now there is a direct path to 'New' which may have been a problem by its omission as a direct subdirectory of F:\BlueIris. The storage structure requirements and recommended paths are fairly specific for the db, New, and Alerts. They cannot be arbitrarily "nested" in other folders as explained in the 'Clip Folders' section of the Help Documentation. Having "New" initially nested as a subfolder of 'archive' would not fall into the 'recommended' category and could also have been part of the problem.

Try a simple back to basics experiment with the following structure:

C:\BlueIris\db
F:\BlueIris\New
F:BlueIris\Alerts
These are required. Stored is not a required folder. Omit it until seeing the results of the basics.

Set size limits with no time limit and 'delete' upon reaching the size limit. For an initial test, use vary small storage sizes to expedite the process. Eliminate any other storage settings including 'Stored'. If this works as it should, then set the desired sizes and any additional extended storage/archiving according to your needs.

The Clip Storage section of the Help file is pretty straightforward and will be directly accessed just by the 'Help' button on the Storage tab of the main Blue Iris Settings page.
I would suggest giving it a quick review.
User avatar
Pogo
Posts: 528
Joined: Tue Jul 18, 2023 7:21 pm
Location: Reportedly in the Area

Re: Storage and clips don't delete as configured

Post by Pogo »

It may also still be helpful if we could see the your actual Blue Iris storage graph(s) and log entries as have been requested several times.

They are both available via the 'Status' page which is displayed by clicking the icon circled below and located at the upper left hand corner of the Blue Iris desktop window.

Status Icon.jpg
Status Icon.jpg (11.04 KiB) Viewed 3232 times
Post Reply